-- Logs begin at Thu 2021-06-17 10:07:15 UTC, end at Thu 2021-06-17 11:22:03 UTC. -- Jun 17 10:51:03.288026 dv-cinder-773870-6-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Jun 17 10:51:05.930213 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.common.config [-] Logging enabled! Jun 17 10:51:05.930781 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev356 Jun 17 10:51:05.931003 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=110105) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Jun 17 10:51:05.934134 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.common.config [-] Logging enabled! Jun 17 10:51:05.934385 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev356 Jun 17 10:51:05.934694 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=110105) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Jun 17 10:51:05.935635 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 10:51:05.935867 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 10:51:05.936226 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 10:51:05.936468 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 10:51:05.936689 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 10:51:05.937002 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.937337 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.937586 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.937811 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.938099 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.938386 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.938663 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.938974 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.939273 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.939598 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.939875 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.940155 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.940380 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.940654 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] config_source = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.940937 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.941218 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.941434 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] debug = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.941708 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.942127 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.942536 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.942813 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.943131 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.943404 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.943672 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.943942 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.944219 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.944545 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] host = dv-cinder-773870-6-iscsi {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.944819 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.945098 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.945379 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.945661 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.945931 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.946202 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.946479 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.946746 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] log_dir = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.947034 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] log_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.947304 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.947587 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.947869 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.948154 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.948374 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.948592 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.948873 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.949162 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.949431 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.949702 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.949995 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.950240 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.950507 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.950768 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.951070 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.951349 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.951629 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.951901 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.952169 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.952435 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.952700 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.952979 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.953246 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.953514 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.953781 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.954062 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.954325 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.954598 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.954905 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.955228 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.955507 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.955787 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.956056 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.956333 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.956599 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.956863 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] use_journal = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.957126 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] use_json = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.957391 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.957653 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.957928 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.958192 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.958457 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.958721 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.959008 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.959294 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:05.959586 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.959877 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.960172 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.960448 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.960738 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.961012 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.961296 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.961571 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.961855 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.962140 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.962422 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.962695 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.962999 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.963270 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.963563 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.963862 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.964153 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.964441 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.964713 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.964983 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.965248 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.965521 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.965802 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.966089 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.966372 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.966639 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.966931 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.967221 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.967493 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.967760 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.968030 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.968314 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.968585 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.968851 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.969132 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.969405 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.969672 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.969940 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.970211 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.970496 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.971314 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.971583 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.971851 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.972122 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.972389 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.972670 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.972942 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.973208 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.973474 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.973747 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.974013 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.974281 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.974552 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.974820 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.975112 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.975378 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.975643 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.975910 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.976202 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.976469 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.976735 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.977001 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.977271 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.977539 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.977805 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.978069 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.978335 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.978600 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.978991 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.979291 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.979573 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.979850 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.980125 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.980399 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.980671 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.980939 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.981211 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.981483 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.981752 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.982037 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.982313 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.982591 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.982884 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.983159 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.983449 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.983720 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.983996 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.984268 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.984593 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.984886 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.985166 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.985456 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.985750 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.986042 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.986902 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.987197 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.987476 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.987783 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.988061 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:05.988273 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 10:51:05.988508 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=110105) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Jun 17 10:51:06.337716 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=110105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:06.337896 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=110105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:06.338176 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=110105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:06.338502 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.manager [-] Loading core plugin: ml2 Jun 17 10:51:06.724909 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.725188 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.725455 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.726758 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.727085 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.727373 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.761613 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.761885 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.762147 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.775726 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.776001 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.776266 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.805596 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.805860 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.806124 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.841344 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.841615 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:06.841874 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.071883 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.072488 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.072488 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.072641 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.073507 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.195068 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.195385 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.195660 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.195927 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.196191 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.196494 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.196743 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.196995 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.197239 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.197517 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.197768 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.198027 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.198277 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.198532 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.198780 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.199061 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.199326 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.199575 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.199834 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.200077 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.200347 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.200684 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.200926 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.201199 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.201439 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.201676 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.202066 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=110105) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jun 17 10:51:07.202303 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=110105) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jun 17 10:51:07.202536 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=110105) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jun 17 10:51:07.202774 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=110105) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jun 17 10:51:07.203028 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=110105) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jun 17 10:51:07.203256 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=110105) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jun 17 10:51:07.204556 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Jun 17 10:51:07.207655 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Jun 17 10:51:07.211531 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Jun 17 10:51:07.215429 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(100, 149)])]) Jun 17 10:51:07.217031 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Jun 17 10:51:07.217488 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Jun 17 10:51:07.217818 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Jun 17 10:51:07.218197 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Jun 17 10:51:07.221705 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Jun 17 10:51:07.221948 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Jun 17 10:51:07.222290 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Jun 17 10:51:07.249779 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Jun 17 10:51:07.250227 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.250522 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=110105) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Jun 17 10:51:07.250904 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.252276 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=110105) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Jun 17 10:51:07.252567 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Jun 17 10:51:07.252888 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Jun 17 10:51:07.256145 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.256425 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:07.320272 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Jun 17 10:51:07.320490 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Jun 17 10:51:07.320711 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Jun 17 10:51:07.321083 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Jun 17 10:51:07.341625 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_db.sqlalchemy.engines [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 10:51:07.990804 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Initializing driver for type 'gre' Jun 17 10:51:07.991283 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] gre ID ranges: [(1, 1000)] Jun 17 10:51:08.196205 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Initializing driver for type 'local' Jun 17 10:51:08.196834 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Initializing driver for type 'vlan' Jun 17 10:51:08.281823 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] VlanTypeDriver initialization complete Jun 17 10:51:08.282090 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Initializing driver for type 'vxlan' Jun 17 10:51:08.282588 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] vxlan ID ranges: [(1, 1000)] Jun 17 10:51:08.482207 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Initializing extension driver 'port_security' Jun 17 10:51:08.482546 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.extensions.port_security [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] PortSecurityExtensionDriver initialization complete Jun 17 10:51:08.482902 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Initializing mechanism driver 'openvswitch' Jun 17 10:51:08.483246 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Initializing mechanism driver 'hyperv' Jun 17 10:51:08.490451 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.plugins.ml2.plugin [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=110105) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:51:08.491260 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > port after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.493138 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > port after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.493138 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > port after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.493138 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > subnet after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.493138 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > subnet after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.493503 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > subnet after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.493503 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > network after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.493765 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > network after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.494101 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > network after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.494472 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > security_group after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.494813 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > security_group after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.495172 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > security_group after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.495542 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.495878 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.496211 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.496580 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > address_group after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.496918 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > address_group after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.497248 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > address_group after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.497578 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] ML2 OVO RPC backend initialized. {{(pid=110105) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:162}} Jun 17 10:51:08.498313 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router_interface after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.498654 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router_interface after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.499086 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > network before_response 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.499427 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > networks before_response 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.499764 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > port before_response 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.500100 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > ports before_response 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.500432 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > subnet before_response 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.500761 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > subnets before_response 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.501101 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > network after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.501434 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > network after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.502326 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > network after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.502734 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > port after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.503100 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > port after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.503440 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > port after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.503771 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > subnet after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.504100 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > subnet after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.504428 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > subnet after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.504996 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.plugin [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Modular L2 Plugin initialization complete Jun 17 10:51:08.505318 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading services supported by the core plugin {{(pid=110105) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Jun 17 10:51:08.505636 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.plugins.ml2.managers [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Got port-security extension from driver 'port_security' Jun 17 10:51:08.506093 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.extensions.vlantransparent [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Disabled vlantransparent extension. Jun 17 10:51:08.506581 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=110105) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Jun 17 10:51:08.506911 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading Plugin: router Jun 17 10:51:08.542036 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router_interface before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.542369 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router after_create 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.542729 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router before_create 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.543106 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router_interface before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.543465 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router_interface after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.543809 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router after_delete 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.544155 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > floatingip after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.544509 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router after_create 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.544845 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router after_update 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.545182 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router after_update 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.545520 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.545867 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router after_update 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.546262 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router precommit_update 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.546618 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: port after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.546981 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: port after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.547314 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: subnet after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.547646 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.547983 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > port precommit_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.548318 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router precommit_create 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.549148 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: port before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.549479 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router precommit_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.549827 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router after_update 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.550167 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router precommit_delete 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.550507 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router precommit_create 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.550872 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router_interface after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.551218 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router precommit_update 55549900 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.551586 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > network after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.552427 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Tracking information for resource: router configured {{(pid=110105) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jun 17 10:51:08.552752 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Tracking information for resource: floatingip configured {{(pid=110105) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Jun 17 10:51:08.557853 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.db.l3_agentschedulers_db [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Jun 17 10:51:08.558425 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: port after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.558779 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: port after_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.559149 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: port after_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.559489 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: port after_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.560381 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router before_create 55550100 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.560740 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router precommit_delete 55550100 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.561092 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router precommit_create 55550100 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.561442 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > router precommit_update 55550100 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.566326 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.services.provider_configuration [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service providers = [] {{(pid=110105) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Jun 17 10:51:08.566681 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.db.servicetype_db [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=110105) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Jun 17 10:51:08.569625 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.services.service_base [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=110105) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Jun 17 10:51:08.569975 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.services.service_base [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=110105) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Jun 17 10:51:08.570311 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.services.service_base [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=110105) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Jun 17 10:51:08.571193 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.services.service_base [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=110105) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Jun 17 10:51:08.571544 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.services.service_base [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Default provider is not specified for service type L3_ROUTER_NAT Jun 17 10:51:08.571909 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=110105) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jun 17 10:51:08.572218 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Jun 17 10:51:08.582732 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Successfully loaded METERING plugin. Description: METERING {{(pid=110105) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jun 17 10:51:08.583094 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading Plugin: auto_allocate Jun 17 10:51:08.588925 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: network precommit_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.589281 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: network precommit_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.589797 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=110105) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jun 17 10:51:08.590110 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading Plugin: tag Jun 17 10:51:08.596580 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=110105) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jun 17 10:51:08.596904 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading Plugin: timestamp Jun 17 10:51:08.602051 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=110105) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jun 17 10:51:08.602382 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading Plugin: network_ip_availability Jun 17 10:51:08.607745 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.608109 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.608457 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.609164 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=110105) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jun 17 10:51:08.609477 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading Plugin: flavors Jun 17 10:51:08.614819 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=110105) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jun 17 10:51:08.615164 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading Plugin: revisions Jun 17 10:51:08.623685 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=110105) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Jun 17 10:51:08.624077 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_concurrency.lockutils [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.286s {{(pid=110105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:08.625096 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=110105) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}} Jun 17 10:51:08.625665 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Initializing extension manager. Jun 17 10:51:08.626315 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: __init__.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.626655 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: __pycache__ {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.627582 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.627913 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: address_group.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.628680 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.629339 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: address-group Jun 17 10:51:08.629660 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: address_scope.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.630342 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.630866 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: address-scope Jun 17 10:51:08.631365 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: admin_state_down_before_update.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.633073 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.633956 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: router-admin-state-down-before-update Jun 17 10:51:08.634370 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: agent.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.635097 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.635608 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: agent Jun 17 10:51:08.635927 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: agent_resources_synced.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.636809 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.637313 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: agent-resources-synced Jun 17 10:51:08.637628 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: allowedaddresspairs.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.639623 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.640141 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: allowed-address-pairs Jun 17 10:51:08.640459 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: auto_allocated_topology.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.641505 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.642013 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: auto-allocated-topology Jun 17 10:51:08.642361 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: availability_zone.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.643064 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.643565 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: availability_zone Jun 17 10:51:08.643881 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: availability_zone_filter.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.644760 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.645261 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: availability_zone_filter Jun 17 10:51:08.645577 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: data_plane_status.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.646450 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.646984 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension data-plane-status not supported by any of loaded plugins Jun 17 10:51:08.647301 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: default_subnetpools.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.648181 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.648679 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: default-subnetpools Jun 17 10:51:08.648995 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: dhcpagentscheduler.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.649787 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.650295 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: dhcp_agent_scheduler Jun 17 10:51:08.650613 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: dns.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.651522 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.652028 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension dns-integration not supported by any of loaded plugins Jun 17 10:51:08.652344 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: dns_domain_ports.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.653219 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.653726 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension dns-domain-ports not supported by any of loaded plugins Jun 17 10:51:08.654042 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: dvr.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.654692 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.655232 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: dvr Jun 17 10:51:08.655546 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: empty_string_filtering.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.656421 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.656925 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: empty-string-filtering Jun 17 10:51:08.657238 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.658636 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.659295 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Jun 17 10:51:08.659608 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.660491 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.660993 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Jun 17 10:51:08.661303 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: external_net.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.662175 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.662677 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: external-net Jun 17 10:51:08.663014 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: extra_dhcp_opt.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.663894 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.664396 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: extra_dhcp_opt Jun 17 10:51:08.664707 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: extraroute.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.665583 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.666085 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: extraroute Jun 17 10:51:08.666427 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: extraroute_atomic.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.667467 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.667978 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: extraroute-atomic Jun 17 10:51:08.668292 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: filter_validation.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.668935 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.669432 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: filter-validation Jun 17 10:51:08.669744 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: fip_pf_description.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.670624 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.671152 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Jun 17 10:51:08.671468 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: fip_port_details.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.672351 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.672855 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: fip-port-details Jun 17 10:51:08.673169 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: flavors.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.675339 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.675874 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: flavors Jun 17 10:51:08.676198 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.677880 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.678401 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Jun 17 10:51:08.678724 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: floatingip_pools.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.679433 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.679944 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: floatingip-pools Jun 17 10:51:08.680263 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: ip_allocation.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.681156 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.681670 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension ip_allocation not supported by any of loaded plugins Jun 17 10:51:08.681989 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: ip_substring_port_filtering.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.682902 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.683419 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: ip-substring-filtering Jun 17 10:51:08.683736 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: l2_adjacency.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.684627 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.685135 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension l2_adjacency not supported by any of loaded plugins Jun 17 10:51:08.685447 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: l3.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.686413 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.686957 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: router Jun 17 10:51:08.687747 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: l3_conntrack_helper.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.689731 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.690266 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension l3-conntrack-helper not supported by any of loaded plugins Jun 17 10:51:08.690594 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: l3_ext_gw_mode.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.691527 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.692038 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: ext-gw-mode Jun 17 10:51:08.692354 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: l3_ext_ha_mode.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.693239 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.693745 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: l3-ha Jun 17 10:51:08.694059 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: l3_flavors.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.694967 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.695473 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: l3-flavors Jun 17 10:51:08.695786 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.696683 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.697190 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: l3-port-ip-change-not-allowed Jun 17 10:51:08.697507 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: l3agentscheduler.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.698547 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.699089 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: l3_agent_scheduler Jun 17 10:51:08.699410 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: logging.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.700897 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.701417 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension logging not supported by any of loaded plugins Jun 17 10:51:08.701739 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: metering.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.702457 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.703072 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: metering Jun 17 10:51:08.703390 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.704463 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.705100 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: metering_source_and_destination_fields Jun 17 10:51:08.705434 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: multiprovidernet.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.706328 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.706864 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: multi-provider Jun 17 10:51:08.707188 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: netmtu.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.708078 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.708586 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: net-mtu Jun 17 10:51:08.708900 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: netmtu_writable.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.709779 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.710289 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: net-mtu-writable Jun 17 10:51:08.710601 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: network_availability_zone.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.711269 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.711772 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: network_availability_zone Jun 17 10:51:08.712082 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: network_ip_availability.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.713144 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.713652 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: network-ip-availability Jun 17 10:51:08.713969 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: network_segment_range.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.714705 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.715246 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension network-segment-range not supported by any of loaded plugins Jun 17 10:51:08.715562 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: pagination.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.716510 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.716832 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: pagination Jun 17 10:51:08.717143 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: port_device_profile.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.718026 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.718541 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: port-device-profile Jun 17 10:51:08.718867 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: port_mac_address_regenerate.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.719774 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.720281 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: port-mac-address-regenerate Jun 17 10:51:08.721132 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: port_numa_affinity_policy.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.722008 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.722512 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: port-numa-affinity-policy Jun 17 10:51:08.722827 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: port_resource_request.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.723798 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.724300 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension port-resource-request not supported by any of loaded plugins Jun 17 10:51:08.724614 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: portbindings.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.725509 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.726020 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: binding Jun 17 10:51:08.726335 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: portbindings_extended.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.727589 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.728102 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: binding-extended Jun 17 10:51:08.728423 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: portsecurity.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.729305 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.729812 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: port-security Jun 17 10:51:08.730125 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: project_id.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.731240 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.731559 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: project-id Jun 17 10:51:08.731874 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: providernet.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.732767 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.733281 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: provider Jun 17 10:51:08.733594 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: qos.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.737678 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.738201 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension qos not supported by any of loaded plugins Jun 17 10:51:08.738527 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: qos_bw_limit_direction.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.739786 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.740305 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Jun 17 10:51:08.740627 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.741519 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.742025 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Jun 17 10:51:08.742343 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: qos_default.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.743256 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.743763 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension qos-default not supported by any of loaded plugins Jun 17 10:51:08.744082 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: qos_fip.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.744711 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.745211 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension qos-fip not supported by any of loaded plugins Jun 17 10:51:08.745527 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: qos_gateway_ip.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.746416 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.746947 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension qos-gateway-ip not supported by any of loaded plugins Jun 17 10:51:08.747265 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: qos_port_network_policy.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.748144 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.748652 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension qos-port-network-policy not supported by any of loaded plugins Jun 17 10:51:08.748969 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: qos_rule_type_details.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.749850 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.750364 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension qos-rule-type-details not supported by any of loaded plugins Jun 17 10:51:08.750678 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: qos_rules_alias.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.751744 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.752257 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension qos-rules-alias not supported by any of loaded plugins Jun 17 10:51:08.752573 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: quotasv2.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.753508 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.753782 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: quotas Jun 17 10:51:08.754091 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: quotasv2_detail.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.767825 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.768163 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: quota_details Jun 17 10:51:08.768489 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: rbac.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.769552 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.770091 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: rbac-policies Jun 17 10:51:08.770426 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: rbac_address_group.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.771365 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.771881 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: rbac-address-group Jun 17 10:51:08.772202 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: rbac_address_scope.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.773102 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.773616 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: rbac-address-scope Jun 17 10:51:08.773940 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: rbac_security_groups.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.775085 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.775606 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: rbac-security-groups Jun 17 10:51:08.775932 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: rbac_subnetpool.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.776825 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.777336 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: rbac-subnetpool Jun 17 10:51:08.777655 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: revisionifmatch.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.778552 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.779094 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: revision-if-match Jun 17 10:51:08.779416 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: revisions.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.780508 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.781021 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: standard-attr-revisions Jun 17 10:51:08.781344 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: router_availability_zone.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.782001 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.782511 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: router_availability_zone Jun 17 10:51:08.782830 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: routerservicetype.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.784350 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.784862 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension router-service-type not supported by any of loaded plugins Jun 17 10:51:08.785180 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.786076 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.786586 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: security-groups-normalized-cidr Jun 17 10:51:08.786937 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: security_groups_port_filtering.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.787842 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.788350 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: port-security-groups-filtering Jun 17 10:51:08.788670 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: security_groups_remote_address_group.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.794554 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.795051 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: security-groups-remote-address-group Jun 17 10:51:08.795371 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: securitygroup.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.805427 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.805962 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: security-group Jun 17 10:51:08.806290 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: segment.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.807088 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.807601 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension segment not supported by any of loaded plugins Jun 17 10:51:08.807925 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.808839 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.809374 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Jun 17 10:51:08.809697 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: servicetype.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.810799 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.811345 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: service-type Jun 17 10:51:08.811667 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: sorting.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.812632 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.812956 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: sorting Jun 17 10:51:08.813273 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: standard_attr_segment.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.814162 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.814678 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension standard-attr-segment not supported by any of loaded plugins Jun 17 10:51:08.815033 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: standardattrdescription.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.815657 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.816160 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: standard-attr-description Jun 17 10:51:08.816476 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: stateful_security_group.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.817369 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.817885 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: stateful-security-group Jun 17 10:51:08.818201 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: stdattrs_common.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.818762 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Jun 17 10:51:08.819103 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.820073 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.820583 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Jun 17 10:51:08.820899 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: subnet_onboard.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.821988 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.822512 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: subnet_onboard Jun 17 10:51:08.822828 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: subnet_segmentid_writable.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.823766 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.824277 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Jun 17 10:51:08.824598 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: subnet_service_types.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.825503 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.826011 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: subnet-service-types Jun 17 10:51:08.826327 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: subnetallocation.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.827443 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.828286 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: subnet_allocation Jun 17 10:51:08.828786 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.829449 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.829991 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: subnetpool-prefix-ops Jun 17 10:51:08.830311 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.837390 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.837904 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Jun 17 10:51:08.838226 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: tagging.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.839309 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.839828 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: standard-attr-tag Jun 17 10:51:08.840151 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: timestamp.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.841418 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.841934 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loaded extension: standard-attr-timestamp Jun 17 10:51:08.842255 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: trunk.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.843301 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.843819 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension trunk not supported by any of loaded plugins Jun 17 10:51:08.844139 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: trunk_details.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.845034 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.846109 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension trunk-details not supported by any of loaded plugins Jun 17 10:51:08.846433 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: uplink_status_propagation.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.847489 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.847885 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension uplink-status-propagation not supported by any of loaded plugins Jun 17 10:51:08.848205 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Loading extension file: vlantransparent.py {{(pid=110105) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Jun 17 10:51:08.848855 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=110105) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Jun 17 10:51:08.849363 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extension vlan-transparent not supported by any of loaded plugins Jun 17 10:51:08.853189 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:network Jun 17 10:51:08.853736 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:subnet Jun 17 10:51:08.854133 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:subnetpool Jun 17 10:51:08.854522 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:port Jun 17 10:51:08.855851 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.859777 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service FLAVORS assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.859777 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.859777 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.859777 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:router Jun 17 10:51:08.859777 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:floatingip Jun 17 10:51:08.859777 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service METERING assigned prefix: /metering {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.860207 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.860406 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.860753 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=110105) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:51:08.862371 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of CountableResource for resource:rbac_policy Jun 17 10:51:08.862870 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:security_group Jun 17 10:51:08.863303 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:security_group_rule Jun 17 10:51:08.863914 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service CORE assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.864257 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:subnetpool Jun 17 10:51:08.864590 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] subnetpool is already registered Jun 17 10:51:08.865030 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service CORE assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.865350 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:subnetpool Jun 17 10:51:08.865676 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] subnetpool is already registered Jun 17 10:51:08.868043 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.868481 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service FLAVORS assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.869100 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.869522 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.869848 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:router Jun 17 10:51:08.870179 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] router is already registered Jun 17 10:51:08.870584 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:floatingip Jun 17 10:51:08.870933 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] floatingip is already registered Jun 17 10:51:08.871385 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service METERING assigned prefix: /metering {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.872059 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of CountableResource for resource:rbac_policy Jun 17 10:51:08.872380 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] rbac_policy is already registered Jun 17 10:51:08.872793 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:security_group Jun 17 10:51:08.873121 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] security_group is already registered Jun 17 10:51:08.873525 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:security_group_rule Jun 17 10:51:08.873851 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] security_group_rule is already registered Jun 17 10:51:08.874497 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service CORE assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.874816 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:subnetpool Jun 17 10:51:08.875173 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] subnetpool is already registered Jun 17 10:51:08.875594 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.v2.resource_helper [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Service CORE assigned prefix: {{(pid=110105) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Jun 17 10:51:08.875912 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Creating instance of TrackedResource for resource:subnetpool Jun 17 10:51:08.876239 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING neutron.quota.resource_registry [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] subnetpool is already registered Jun 17 10:51:08.876744 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: extensions {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.878206 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: address-groups {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.879719 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: address-scopes {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.881028 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: agents {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.882440 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: auto-allocated-topology {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.883722 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: availability_zones {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.884935 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: dhcp-networks {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.888603 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: dhcp-agents {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.888603 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: routers {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.889562 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: flavors {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.891998 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: service_profiles {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.893253 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: next_providers {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.894670 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: service_profiles {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.896257 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: floatingip-pools {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.897465 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: routers {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.899199 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: floatingips {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.900495 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: l3-routers {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.901882 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: l3-agents {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.903341 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: metering-labels {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.904606 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: metering-label-rules {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.905973 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: network-ip-availabilities {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.907263 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: bindings {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.911658 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: quotas {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.913198 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: quotas {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.914638 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: rbac-policies {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.916057 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: security-groups {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.917351 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: security-group-rules {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.918590 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: service-providers {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.919867 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: subnetpools {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.921192 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: subnetpools {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.922738 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: tags {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.925135 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: tags {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.927017 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: tags {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.928815 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: tags {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.930508 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: tags {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.932483 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: tags {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.934185 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: tags {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.936157 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: tags {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.938031 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: tags {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.939850 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron.api.extensions [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Extended resource: tags {{(pid=110105) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Jun 17 10:51:08.946219 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING keystonemiddleware.auth_token [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 10:51:08.951027 dv-cinder-773870-6-iscsi neutron-server[110105]: WARNING keystonemiddleware.auth_token [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 10:51:08.962751 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_concurrency.lockutils [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Acquired lock "singleton_lock" {{(pid=110105) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jun 17 10:51:08.963258 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_concurrency.lockutils [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Releasing lock "singleton_lock" {{(pid=110105) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jun 17 10:51:08.963896 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO oslo_service.service [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Starting 2 workers Jun 17 10:51:08.968606 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Started child 110214 {{(pid=110105) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jun 17 10:51:08.973500 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Started child 110215 {{(pid=110105) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jun 17 10:51:08.974621 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:08.975341 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO neutron.service [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Neutron service started, listening on 0.0.0.0:9696 Jun 17 10:51:08.975821 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Notify callbacks [] for process, before_spawn {{(pid=110105) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:08.976145 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [-] (110214) wsgi starting up on http://0.0.0.0:9696 Jun 17 10:51:08.978328 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO oslo_service.service [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Starting 1 workers Jun 17 10:51:08.978596 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:08.980014 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [-] (110215) wsgi starting up on http://0.0.0.0:9696 Jun 17 10:51:08.983423 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Started child 110216 {{(pid=110105) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jun 17 10:51:08.983948 dv-cinder-773870-6-iscsi neutron-server[110105]: INFO oslo_service.service [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Starting 1 workers Jun 17 10:51:08.987658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 57226) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:51:08.988264 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.service [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] calling RpcWorker wait() {{(pid=110216) _wait /opt/stack/neutron/neutron/service.py:128}} Jun 17 10:51:08.988792 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.service [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] returning from RpcWorker wait() {{(pid=110216) _wait /opt/stack/neutron/neutron/service.py:135}} Jun 17 10:51:08.989172 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Started child 110218 {{(pid=110105) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jun 17 10:51:08.990068 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG neutron_lib.callbacks.manager [None req-9cd27a47-73be-480c-a370-39782ac8755c None None] Notify callbacks [] for process, after_spawn {{(pid=110105) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:08.990174 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:08.990594 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:51:08.992052 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=110105) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jun 17 10:51:08.992268 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 10:51:08.992451 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 10:51:08.992822 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 10:51:08.993323 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 10:51:08.993633 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 10:51:08.994277 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:08.994404 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:08.995240 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:08.995585 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:51:08.995824 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:08.996230 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:08.996659 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:08.997391 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:08.997810 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:08.998209 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:08.998640 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:08.999054 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:08.999371 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:08.999753 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.000010 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [-] 10.222.0.41 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0084226 Jun 17 10:51:09.000406 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.000804 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.001268 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.002544 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.003005 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.004494 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.004884 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.006098 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] config_source = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.006545 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.007281 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.007732 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] debug = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.008181 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.009796 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.010240 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.010668 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.011274 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.011749 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.012239 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.012548 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.012800 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.013055 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.014390 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.014390 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.014390 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.014390 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.014390 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.016045 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.016045 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.016321 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] host = dv-cinder-773870-6-iscsi {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.016563 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.016810 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.017041 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.017834 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.018089 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.018310 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.018566 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.018816 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.019931 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.021504 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.021641 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.021849 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.023717 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_dir = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.023717 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.023717 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_options = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.023717 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.026767 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.026767 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.026767 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.026767 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.026767 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.026767 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.026767 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027208 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027208 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027208 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027208 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027208 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027208 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027208 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027208 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027644 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027644 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027769 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.027967 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.028221 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.028452 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.028671 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.028912 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.029150 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.029390 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.029615 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.030794 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.031055 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.031323 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.031560 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.031831 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.032074 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.032327 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.032711 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.033112 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.033788 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.034934 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.034934 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.035273 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.036206 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.037333 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.037598 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.037815 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.038197 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_journal = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.038441 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_json = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.038678 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.038992 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.040012 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.040241 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.040577 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.041609 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.041836 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.042080 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.042525 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.042814 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.043272 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.043597 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.043856 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049221 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049221 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049221 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049221 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049221 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049221 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049221 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049221 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049755 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049755 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049755 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049755 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.049755 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.050047 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.050354 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.050354 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.050592 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.050957 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.051277 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.051486 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.41/identity {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.051760 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.051980 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.052222 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.052462 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.052691 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.052969 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.053203 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.053602 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.053722 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.053909 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.055204 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.055204 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.055204 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.055427 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.055864 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.055969 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.056141 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.056364 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.056606 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.056857 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.057098 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.057808 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.057808 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.057808 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.058019 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.058242 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.058487 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.058721 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.058974 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.059220 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.059461 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.059679 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.060344 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.060344 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.060344 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.060569 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.060765 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.060984 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.061959 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.061959 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.061959 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.061959 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.062240 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.062320 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.062961 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.062961 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.062961 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.063228 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.063406 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.063611 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.063841 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.064051 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.064290 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.064541 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.064723 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.064942 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.065151 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.069769 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.070050 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.073595 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.073595 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.073595 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.073595 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.073595 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.073595 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.073595 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.073595 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.074122 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.074122 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.074122 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.074122 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.074365 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.074576 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.074716 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.074992 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.075267 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.075526 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.075776 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.076009 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.076251 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.076502 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.076763 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.077030 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.077297 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.077536 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.077786 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.078094 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.080354 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.080354 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.080354 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.081918 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.082232 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.082511 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.082995 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.083372 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.083652 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.083931 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.084183 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.084511 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.084759 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.085001 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.085230 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.086150 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.086150 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.086150 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.087529 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.087529 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.087529 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.087529 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.087529 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.087837 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.088069 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.088251 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.088492 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.088755 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.088755 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.088755 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.089608 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.089686 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.41/identity {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.089971 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.090333 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.090579 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.090794 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.091111 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.091328 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.092536 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.092536 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.092536 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.092536 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.092811 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.092890 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.093100 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.093336 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.093558 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.093792 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.094022 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.094238 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.094480 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.094697 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.094929 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.095150 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.095384 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.096235 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.096477 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.096774 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.097029 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.097234 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.097460 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.097683 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.097915 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.098126 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.098368 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.098612 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.098788 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.099046 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.102904 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.102904 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.102904 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.102904 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.102904 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.102904 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.102904 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.102904 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103424 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103424 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103424 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103424 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103424 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103424 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103424 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103424 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103874 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103874 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103874 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.103874 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.104099 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.104165 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.104506 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.104599 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.104737 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.104944 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.105222 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.105477 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.105710 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.105941 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.106168 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.106389 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.106591 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.106795 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.107126 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.108684 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.108960 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.109630 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.109630 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.109895 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.110036 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.110300 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.110535 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.110752 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.111017 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.111289 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.111536 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.111756 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.112242 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.112486 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.112704 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.113143 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.113401 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.115686 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.115900 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.116171 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.116436 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.116713 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.117496 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.117496 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.117496 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.117720 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.117960 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.118202 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.118544 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.118947 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.119212 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.119418 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.120124 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.120124 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.120282 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.120525 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.120779 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.121071 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.121382 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.121657 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.121911 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.122169 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.122439 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.122657 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.123686 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.123941 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.124182 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.124400 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.124640 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.124870 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.125114 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.125352 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.125594 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.125834 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.126074 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.126306 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.126543 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.126839 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.126990 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 10:51:09.127529 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=110105) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jun 17 10:51:09.127695 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 10:51:09.127849 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 10:51:09.136207 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 10:51:09.136207 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 10:51:09.136207 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 10:51:09.136207 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136207 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136207 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136207 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136207 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136688 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136688 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136688 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136688 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136688 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136688 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136688 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.136688 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137168 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137168 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137168 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137168 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137168 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137168 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137168 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] config_source = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137168 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137608 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137608 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] debug = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137608 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137608 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137608 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137608 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137977 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137977 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137977 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137977 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137977 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137977 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137977 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.137977 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138416 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138416 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138416 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138416 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138416 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138416 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] host = dv-cinder-773870-6-iscsi {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138416 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138416 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138905 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138905 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138905 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138905 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138905 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138905 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138905 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.138905 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139351 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139351 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139351 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_dir = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139351 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139351 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_options = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139351 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139351 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139351 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139797 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139797 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139797 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139797 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139797 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139797 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.139797 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140189 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140189 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140189 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140189 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140189 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140189 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140189 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140189 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140659 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140659 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140659 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140659 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140659 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140659 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140659 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.140659 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.141096 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.141096 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.141096 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.141096 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.141317 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.141317 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.141487 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.141766 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.141864 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.142883 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.142883 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.142883 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.143092 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.143092 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.143296 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.143406 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.143559 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.143710 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.143857 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_journal = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.144076 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_json = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.144159 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.144295 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.144438 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.144591 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.144764 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.144914 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.145060 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.145206 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 10:51:09.145371 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.145516 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.145675 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.145827 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.145985 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.146482 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.146482 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.146482 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.146690 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.146757 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.146914 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.147041 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.147202 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.147351 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.147515 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.147694 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.147883 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.148038 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.148182 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.148322 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.148488 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.148643 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.148812 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.148962 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.149529 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.41/identity {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.149529 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.149529 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.149849 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.149849 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.149849 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.150135 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.150135 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.150346 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.150458 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.150582 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.150731 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.150918 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.151068 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.151208 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.151347 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.152258 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.152258 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.152258 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.152258 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.152258 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.152846 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.152846 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.152846 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.152846 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.153408 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.153408 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.153408 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.153702 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.153702 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.153905 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.153905 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.154100 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.154244 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.154392 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.154532 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.154669 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.154804 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.154926 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.155071 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.155226 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.155383 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.155539 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.155723 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.155863 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.155987 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.156135 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.156296 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.156516 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.156642 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.156750 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.156890 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.157045 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.157201 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.157560 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.157560 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.157771 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.161236 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.161236 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.161236 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.161236 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.161236 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.161236 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.161236 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.161236 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166311 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166311 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166311 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166311 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166311 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166311 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166311 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166311 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166926 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166926 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166926 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166926 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166926 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166926 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166926 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.166926 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167451 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167451 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167451 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167451 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167451 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167451 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167451 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167451 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167985 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167985 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167985 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167985 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167985 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167985 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167985 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.167985 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.168520 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.168520 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.168520 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.168520 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.168520 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.168520 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.168520 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.168520 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169039 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169039 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169039 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169039 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169039 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169039 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169039 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169039 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169475 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169475 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169475 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169475 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169709 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.169775 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.170129 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.41/identity {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.170129 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.170275 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.170342 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:51:09.170431 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.170504 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.170640 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.170797 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.171213 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.171213 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.171575 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.171575 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.171575 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.172009 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.172009 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.172009 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.172223 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.172397 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.172495 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.173366 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.173366 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.173366 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.173366 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.173366 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.173366 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.174045 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.174045 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.174045 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.174045 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.174425 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.174425 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.174425 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.174823 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.174823 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.174823 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.175193 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.175193 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.175403 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.175513 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.175618 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.175733 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.175860 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.176020 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.176175 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.176330 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.176503 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.176659 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.176814 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.176969 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.177127 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.177282 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.177438 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.177594 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.177749 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.177904 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.178060 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.178216 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.178375 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.178535 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.178690 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.178866 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.179781 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.179943 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.180100 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.180271 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.180427 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.181404 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.181404 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.181404 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.181404 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.181404 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.181404 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.182243 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.182243 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.182243 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.182243 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.182243 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.183906 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.183906 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.183906 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.183906 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.183906 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.183906 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.183906 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.183906 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.183906 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.184576 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.184576 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.184576 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.184576 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.184576 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.184576 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.185185 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.185185 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.185185 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.185185 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.186063 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.186063 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.186063 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.186063 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.186063 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.186063 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.186622 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.186622 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.186622 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.186622 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.187019 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.187019 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.187019 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.187227 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.187336 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.187501 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.187670 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.187824 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.187971 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.188128 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.188284 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.188441 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.188630 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.188756 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.188912 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.189068 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.189249 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.189406 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.189562 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.189719 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.189872 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.190028 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.190364 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.190529 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.190685 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.190840 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 10:51:09.191013 dv-cinder-773870-6-iscsi neutron-server[110105]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 10:51:20.596580 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-162981c7-ac3a-4d5a-bce6-ed77a56d20f5 None None] get_active_networks_info from dv-cinder-773870-6-iscsi {{(pid=110216) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Jun 17 10:51:20.684500 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-162981c7-ac3a-4d5a-bce6-ed77a56d20f5 None None] No non-hosted networks {{(pid=110216) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Jun 17 10:51:20.718003 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.agentschedulers_db [None req-162981c7-ac3a-4d5a-bce6-ed77a56d20f5 None None] DHCP Agent not found on host dv-cinder-773870-6-iscsi {{(pid=110216) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Jun 17 10:51:20.925282 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-b32552b3-4a33-40ec-bbb4-b3f47b1a652c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143'] for agent, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:23.339643 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-12d10d23-f451-478d-bce3-efd812dde0be None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143'] for agent, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:23.368822 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.db.api [None req-2dffa38f-106b-483e-a6f3-0b9567e03c44 None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-cinder-773870-6-iscsi {{(pid=110216) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Jun 17 10:51:23.369693 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_db.api [None req-2dffa38f-106b-483e-a6f3-0b9567e03c44 None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jun 17 10:51:23.556639 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143'] for agent, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:23.558139 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.558781 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.559438 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.559982 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.560521 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.561073 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.561622 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.562179 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.562710 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.563327 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.564051 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.564649 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:23.565248 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-773870-6-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:51:23.577908 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-773870-6-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:51:23.954675 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2dffa38f-106b-483e-a6f3-0b9567e03c44 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:24.451062 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143'] for agent, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:26.762939 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.db.l3_hamode_db [None req-f6378134-49c5-48fa-89b1-092bdc666c08 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Jun 17 10:51:26.841345 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6378134-49c5-48fa-89b1-092bdc666c08 None None] Routers set() bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 10:51:26.841755 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6378134-49c5-48fa-89b1-092bdc666c08 None None] Router IDs set() for agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}} Jun 17 10:51:26.845379 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143'] for agent, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:27.710283 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 57332) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:51:28.212852 dv-cinder-773870-6-iscsi neutron-server[110215]: WARNING oslo_policy.policy [None req-feaa790e-253d-4be2-b80f-9773f3420cf5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jun 17 10:51:28.213463 dv-cinder-773870-6-iscsi neutron-server[110215]: WARNING oslo_policy.policy [None req-feaa790e-253d-4be2-b80f-9773f3420cf5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jun 17 10:51:28.426756 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [None req-feaa790e-253d-4be2-b80f-9773f3420cf5 admin admin] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110215) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 10:51:28.427832 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-feaa790e-253d-4be2-b80f-9773f3420cf5 admin admin] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.7166142 Jun 17 10:51:30.727603 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 57346) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:51:31.036645 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-ce2e2fd2-7c91-4235-acb0-cee7b5cd92a6 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'shared': True, 'default_prefixlen': 26, 'is_default': True, 'name': 'shared-default-subnetpool-v4'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:51:31.133845 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.policy [None req-ce2e2fd2-7c91-4235-acb0-cee7b5cd92a6 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=110215) register_rules /opt/stack/neutron/neutron/policy.py:73}} Jun 17 10:51:31.179145 dv-cinder-773870-6-iscsi neutron-server[110215]: WARNING oslo_policy.policy [None req-ce2e2fd2-7c91-4235-acb0-cee7b5cd92a6 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jun 17 10:51:31.179862 dv-cinder-773870-6-iscsi neutron-server[110215]: WARNING oslo_policy.policy [None req-ce2e2fd2-7c91-4235-acb0-cee7b5cd92a6 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jun 17 10:51:31.188419 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.quota [None req-ce2e2fd2-7c91-4235-acb0-cee7b5cd92a6 admin admin] Loaded quota_driver: . Jun 17 10:51:31.394967 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ce2e2fd2-7c91-4235-acb0-cee7b5cd92a6 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8743361480335', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8743361479794', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8743361507386', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8743361510988', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8743361457159', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8743361448356', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-981086', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-955095', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-7883910', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-7913462'] for rbac-policy, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:31.650619 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ce2e2fd2-7c91-4235-acb0-cee7b5cd92a6 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:31.651760 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-ce2e2fd2-7c91-4235-acb0-cee7b5cd92a6 admin admin] 10.222.0.41 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.9232018 Jun 17 10:51:34.200180 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 57358) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:51:34.499355 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'private', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'project_id': '617d6b16df94411b89a439581740b0bd'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:51:34.596155 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Made reservation on behalf of 617d6b16df94411b89a439581740b0bd for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:51:34.599192 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:34.615522 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:34.738050 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:34.816066 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:34.821397 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:34.841655 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] vlan segment allocate from pool success with {'vlan_id': 124, 'physical_network': 'physnet1'} {{(pid=110215) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 10:51:34.866340 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8743358330152', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:34.866885 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Unsubscribe: segment precommit_create {{(pid=110215) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Jun 17 10:51:34.867390 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Added segment 28b8363e-106d-4984-a657-b73ffa4c27da of type vlan for network c9e09c5d-dfd8-4c60-acee-500064545344 Jun 17 10:51:34.873956 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=522a0275-9035-4cb2-a3a5-46992361bd38,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:51:34.896345 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.896689 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.897015 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.897329 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.897638 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.898033 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.898268 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.898591 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.898932 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.899241 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.899541 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.899841 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Tracked resource versions report: Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: pushed versions: Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: { 'AddressGroup': {'1.2'}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'ConntrackHelper': {'1.0'}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Log': {'1.0'}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Network': {'1.1'}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Port': {'1.7'}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'PortForwarding': {'1.2'}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'QosPolicy': {'1.8'}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SecurityGroup': {'1.4'}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SecurityGroupRule': {'1.2'}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SubPort': {'1.0'}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Subnet': {'1.1'}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Trunk': {'1.1'}} Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: consumer versions: Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: { DHCP agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: L3 agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: Metadata agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: Metering agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: Open vSwitch agent@dv-cinder-773870-6-iscsi: { 'AddressGroup': '1.2', Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'ConntrackHelper': '1.0', Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Log': '1.0', Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Network': '1.1', Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Port': '1.7', Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'PortForwarding': '1.2', Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'QosPolicy': '1.8', Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SecurityGroup': '1.4', Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SecurityGroupRule': '1.2', Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SubPort': '1.0', Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Subnet': '1.1', Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Trunk': '1.1'}} Jun 17 10:51:34.900899 dv-cinder-773870-6-iscsi neutron-server[110215]: {{(pid=110215) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jun 17 10:51:34.982164 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:34.988337 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:35.096396 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:35.097830 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:51:35.098460 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:35.101286 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:35.193028 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Pushing event updated for resources: {'Network': ['ID=c9e09c5d-dfd8-4c60-acee-500064545344,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:51:35.196815 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:35.205575 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network c9e09c5d-dfd8-4c60-acee-500064545344 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 10:51:35.208555 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 1.0073586 Jun 17 10:51:37.820373 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 57372) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:51:38.209723 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0760dc25-a630-4601-81f6-5ac2360564a3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:51:38.211073 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-0760dc25-a630-4601-81f6-5ac2360564a3 admin admin] 10.222.0.41 "GET /v2.0/networks/c9e09c5d-dfd8-4c60-acee-500064545344 HTTP/1.1" status: 200 len: 825 time: 0.3896649 Jun 17 10:51:38.234456 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-3df789e4-4f81-4007-b2dc-fd8873aece26 admin admin] 10.222.0.41 "GET /v2.0/subnetpools/6ffcd63d-66b7-4cf7-83fa-2565b88134bf HTTP/1.1" status: 200 len: 734 time: 0.0180666 Jun 17 10:51:38.242758 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Request body: {'subnet': {'tenant_id': '617d6b16df94411b89a439581740b0bd', 'gateway_ip': '172.20.0.1', 'name': 'private-subnet', 'ip_version': 4, 'subnetpool_id': '6ffcd63d-66b7-4cf7-83fa-2565b88134bf', 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:51:38.321301 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Made reservation on behalf of 617d6b16df94411b89a439581740b0bd for: {'subnet': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:51:38.323565 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Notify callbacks [] for subnet, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:38.696501 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485'] for subnet, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:38.701157 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:38.768663 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Pushing event updated for resources: {'Subnet': ['ID=5c44281f-05c8-4726-ba59-2f0f3848e0a7,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:51:38.770556 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Checking segment: {'id': '28b8363e-106d-4984-a657-b73ffa4c27da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:51:38.771026 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Network hostable DHCP agents. Network: c9e09c5d-dfd8-4c60-acee-500064545344, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110215) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 10:51:38.776733 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:38.907931 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Network c9e09c5d-dfd8-4c60-acee-500064545344 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110215) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 10:51:38.972970 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, c9e09c5d-dfd8-4c60-acee-500064545344) {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:51:38.977528 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:51:38.978209 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:38.982292 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1e755e4-deee-46c4-b937-9883564cb4a9 None None] Network c9e09c5d-dfd8-4c60-acee-500064545344 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:51:39.080420 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.8408375 Jun 17 10:51:39.320024 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5498e9f9-7e24-5c53-b771-9493a76e3e58-c9e09c5d-dfd8-4c60-acee-500064545344', 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'fixed_ips': [{'subnet_id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7'}]}} from dv-cinder-773870-6-iscsi. {{(pid=110216) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Jun 17 10:51:39.321161 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:39.594468 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.db_base_plugin_common [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Allocated IP 172.20.0.2 (c9e09c5d-dfd8-4c60-acee-500064545344/5c44281f-05c8-4726-ba59-2f0f3848e0a7/e91ddbc4-59e8-47d8-99c7-25ea402af786) {{(pid=110216) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 10:51:39.831962 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Notify callbacks [] for port, precommit_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:39.846871 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Transition to ACTIVE for port object e91ddbc4-59e8-47d8-99c7-25ea402af786 will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:51:39.869039 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Transition to ACTIVE for port object e91ddbc4-59e8-47d8-99c7-25ea402af786 will not be triggered until provisioned by entity DHCP. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:51:39.965207 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:39.969084 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:40.030184 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Network c9e09c5d-dfd8-4c60-acee-500064545344 is already hosted by enough agents. {{(pid=110216) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:51:40.035374 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.base_scheduler [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Resources bound (agent type, host, resource id): {{(pid=110216) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:51:40.046033 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Received port after_create {{(pid=110216) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 10:51:40.059531 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Pushing event updated for resources: {'Port': ['ID=e91ddbc4-59e8-47d8-99c7-25ea402af786,revision_number=1']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:51:40.101686 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.101985 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.102322 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.102649 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.103004 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.103332 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.103650 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.103969 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.104301 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.104622 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.104936 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.105249 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Tracked resource versions report: Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: pushed versions: Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: { 'AddressGroup': {'1.2'}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'ConntrackHelper': {'1.0'}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Log': {'1.0'}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Network': {'1.1'}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Port': {'1.7'}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'PortForwarding': {'1.2'}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'QosPolicy': {'1.8'}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SecurityGroup': {'1.4'}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SecurityGroupRule': {'1.2'}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SubPort': {'1.0'}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Subnet': {'1.1'}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Trunk': {'1.1'}} Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: consumer versions: Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: { DHCP agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: L3 agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: Metadata agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: Metering agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: Open vSwitch agent@dv-cinder-773870-6-iscsi: { 'AddressGroup': '1.2', Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'ConntrackHelper': '1.0', Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Log': '1.0', Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Network': '1.1', Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Port': '1.7', Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'PortForwarding': '1.2', Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'QosPolicy': '1.8', Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SecurityGroup': '1.4', Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SecurityGroupRule': '1.2', Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SubPort': '1.0', Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Subnet': '1.1', Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Trunk': '1.1'}} Jun 17 10:51:40.106362 dv-cinder-773870-6-iscsi neutron-server[110216]: {{(pid=110216) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jun 17 10:51:40.127492 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:40.137696 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Attempting to bind port e91ddbc4-59e8-47d8-99c7-25ea402af786 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 10:51:40.138088 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Attempting to bind port e91ddbc4-59e8-47d8-99c7-25ea402af786 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '28b8363e-106d-4984-a657-b73ffa4c27da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 10:51:40.138526 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Attempting to bind port e91ddbc4-59e8-47d8-99c7-25ea402af786 on network c9e09c5d-dfd8-4c60-acee-500064545344 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:51:40.143418 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 10, 51, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 10:51:40.143824 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Checking segment: {'id': '28b8363e-106d-4984-a657-b73ffa4c27da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:51:40.144305 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:40.144703 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Bound using segment: {'id': '28b8363e-106d-4984-a657-b73ffa4c27da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 10:51:40.145194 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Bound port: e91ddbc4-59e8-47d8-99c7-25ea402af786, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '28b8363e-106d-4984-a657-b73ffa4c27da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 10:51:40.145583 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:40.212135 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] For port e91ddbc4-59e8-47d8-99c7-25ea402af786, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 10:51:40.216310 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] For port e91ddbc4-59e8-47d8-99c7-25ea402af786, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=e91ddbc4-59e8-47d8-99c7-25ea402af786,segment=NetworkSegment(28b8363e-106d-4984-a657-b73ffa4c27da),segment_id=28b8363e-106d-4984-a657-b73ffa4c27da)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 10:51:40.282118 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:40.285797 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:40.350253 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Pushing event updated for resources: {'Port': ['ID=e91ddbc4-59e8-47d8-99c7-25ea402af786,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:51:40.353432 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:41.468252 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 57380) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:51:41.799271 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [None req-5850271d-1e04-4b51-bee7-97f8bfc0c309 admin admin] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110215) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 10:51:41.819452 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-5850271d-1e04-4b51-bee7-97f8bfc0c309 admin admin] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3500779 Jun 17 10:51:44.171135 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 57388) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:51:44.479742 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [None req-7e8352ac-5de6-46c9-8fd5-fefc72e8a2e5 admin admin] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110215) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 10:51:44.494885 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-7e8352ac-5de6-46c9-8fd5-fefc72e8a2e5 admin admin] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3086209 Jun 17 10:51:45.520033 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device e91ddbc4-59e8-47d8-99c7-25ea402af786 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:51:45.664207 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port e91ddbc4-59e8-47d8-99c7-25ea402af786 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:51:46.051797 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 5 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:51:46.421341 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57a673da-9c55-4a1e-86a6-3f9ba535b0c8 None None] Network c9e09c5d-dfd8-4c60-acee-500064545344 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:51:46.617993 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-50e5fabe-c9c7-409b-9149-259b5816e607 None None] Provisioning for port e91ddbc4-59e8-47d8-99c7-25ea402af786 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:51:46.632094 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-50e5fabe-c9c7-409b-9149-259b5816e607 None None] Provisioning complete for port e91ddbc4-59e8-47d8-99c7-25ea402af786 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:51:46.632094 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-50e5fabe-c9c7-409b-9149-259b5816e607 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:46.760311 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-50e5fabe-c9c7-409b-9149-259b5816e607 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:46.803254 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-50e5fabe-c9c7-409b-9149-259b5816e607 None None] For port e91ddbc4-59e8-47d8-99c7-25ea402af786, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=e91ddbc4-59e8-47d8-99c7-25ea402af786,segment=NetworkSegment(28b8363e-106d-4984-a657-b73ffa4c27da),segment_id=28b8363e-106d-4984-a657-b73ffa4c27da)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:51:46.913909 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-50e5fabe-c9c7-409b-9149-259b5816e607 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:46.916594 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:46.967001 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e5fabe-c9c7-409b-9149-259b5816e607 None None] Pushing event updated for resources: {'Port': ['ID=e91ddbc4-59e8-47d8-99c7-25ea402af786,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:51:46.970758 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-50e5fabe-c9c7-409b-9149-259b5816e607 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:47.035827 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-421168df-7dc2-4192-be98-bc3ca1c1de34 None None] Provisioning complete for port e91ddbc4-59e8-47d8-99c7-25ea402af786 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:51:47.036199 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-421168df-7dc2-4192-be98-bc3ca1c1de34 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:47.122695 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 57402) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:51:47.451212 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-b4087554-fdfb-4d73-ad41-7dba05a27676 admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': '617d6b16df94411b89a439581740b0bd'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:51:47.488941 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device e91ddbc4-59e8-47d8-99c7-25ea402af786 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:51:47.534267 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port e91ddbc4-59e8-47d8-99c7-25ea402af786 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:51:47.534633 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:47.535956 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b4087554-fdfb-4d73-ad41-7dba05a27676 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8358582', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1816'] for router, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:47.537567 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b4087554-fdfb-4d73-ad41-7dba05a27676 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8357919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8287158', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-8346348', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2019'] for router, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:47.671698 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b4087554-fdfb-4d73-ad41-7dba05a27676 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:47.731194 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b4087554-fdfb-4d73-ad41-7dba05a27676 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8358543', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8287186'] for router, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:47.804380 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b4087554-fdfb-4d73-ad41-7dba05a27676 admin admin] Notify callbacks [] for router, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:47.805525 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-b4087554-fdfb-4d73-ad41-7dba05a27676 admin admin] 10.222.0.41 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6817749 Jun 17 10:51:50.192063 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 57410) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:51:50.497293 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [None req-1e995270-116d-4300-a8db-823523d0e560 admin admin] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110215) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 10:51:50.498255 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-1e995270-116d-4300-a8db-823523d0e560 admin admin] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3052580 Jun 17 10:51:50.607598 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-75fd6112-c799-4402-800d-48b709dba428 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:52.834603 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 57418) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:51:53.137611 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Request body: {'network': {'provider:network_type': 'flat', 'is_default': True, 'provider:physical_network': 'physnet1', 'admin_state_up': True, 'name': 'public', 'router:external': True}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:51:53.246631 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Made reservation on behalf of 846a6ac708f34c3a80ec503ab7a66b3a for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:51:53.248880 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:53.259740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:53.342473 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:53.366970 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-be11a0cd-a799-4ed7-b758-35d34343cf00 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:53.469478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:53.475004 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:53.485668 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Reserving flat network on physical network physnet1 {{(pid=110215) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Jun 17 10:51:53.515137 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=afc3d598-a4a0-48ce-9ae6-164816e77af3,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:51:53.515137 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:53.515137 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:53.515137 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Added segment 402f72d8-702e-43eb-a72d-76f851a64294 of type flat for network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 Jun 17 10:51:53.557054 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:53.589665 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:53.663987 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:53.665309 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:51:53.665882 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:53.668861 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:53.727705 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Pushing event updated for resources: {'Network': ['ID=ae4da6f8-a7ac-4884-8d49-a1c679d58f18,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:51:53.730661 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:53.737542 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 10:51:53.750955 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.9152477 Jun 17 10:51:54.378251 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:56.125769 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 57436) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:51:56.346725 dv-cinder-773870-6-iscsi neutron-server[110214]: WARNING oslo_policy.policy [None req-89313287-3aec-48d9-bbe0-389b89f0f022 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jun 17 10:51:56.347363 dv-cinder-773870-6-iscsi neutron-server[110214]: WARNING oslo_policy.policy [None req-89313287-3aec-48d9-bbe0-389b89f0f022 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jun 17 10:51:56.715584 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:56.750054 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.policy [None req-89313287-3aec-48d9-bbe0-389b89f0f022 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=110214) register_rules /opt/stack/neutron/neutron/policy.py:73}} Jun 17 10:51:56.796283 dv-cinder-773870-6-iscsi neutron-server[110214]: WARNING oslo_policy.policy [None req-89313287-3aec-48d9-bbe0-389b89f0f022 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jun 17 10:51:56.796645 dv-cinder-773870-6-iscsi neutron-server[110214]: WARNING oslo_policy.policy [None req-89313287-3aec-48d9-bbe0-389b89f0f022 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Jun 17 10:51:56.804903 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89313287-3aec-48d9-bbe0-389b89f0f022 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:51:56.806804 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-89313287-3aec-48d9-bbe0-389b89f0f022 admin admin] 10.222.0.41 "GET /v2.0/subnets/5c44281f-05c8-4726-ba59-2f0f3848e0a7 HTTP/1.1" status: 200 len: 849 time: 0.6784358 Jun 17 10:51:56.970398 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-36638243-c2ca-4d93-92bb-30d45f3ef37c admin admin] 10.222.0.41 "GET /v2.0/routers/f209e704-54d3-448c-9f9c-4ed923402fad HTTP/1.1" status: 200 len: 704 time: 0.1581984 Jun 17 10:51:57.229914 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:57.557664 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Allocated IP 172.20.0.1 (c9e09c5d-dfd8-4c60-acee-500064545344/5c44281f-05c8-4726-ba59-2f0f3848e0a7/eb019455-7660-49c6-956b-e60b632a1b70) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 10:51:57.793532 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:57.816685 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.provisioning_blocks [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Transition to ACTIVE for port object eb019455-7660-49c6-956b-e60b632a1b70 will not be triggered until provisioned by entity DHCP. {{(pid=110214) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:51:57.965115 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:57.969198 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:58.023670 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Network c9e09c5d-dfd8-4c60-acee-500064545344 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:51:58.028323 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:51:58.077343 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Pushing event updated for resources: {'Port': ['ID=eb019455-7660-49c6-956b-e60b632a1b70,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:51:58.081001 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 10:51:58.081379 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8290659'] for router_interface, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:58.141505 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.142415 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.142984 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.143112 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.143424 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.143995 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.144096 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.144400 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.144733 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.145052 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.145360 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.145661 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Tracked resource versions report: Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: pushed versions: Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: { 'AddressGroup': {'1.2'}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'ConntrackHelper': {'1.0'}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Log': {'1.0'}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Network': {'1.1'}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Port': {'1.7'}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'PortForwarding': {'1.2'}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'QosPolicy': {'1.8'}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SecurityGroup': {'1.4'}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SecurityGroupRule': {'1.2'}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SubPort': {'1.0'}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Subnet': {'1.1'}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Trunk': {'1.1'}} Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: consumer versions: Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: { DHCP agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: L3 agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: Metadata agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: Metering agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: Open vSwitch agent@dv-cinder-773870-6-iscsi: { 'AddressGroup': '1.2', Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'ConntrackHelper': '1.0', Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Log': '1.0', Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Network': '1.1', Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Port': '1.7', Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'PortForwarding': '1.2', Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'QosPolicy': '1.8', Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SecurityGroup': '1.4', Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SecurityGroupRule': '1.2', Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SubPort': '1.0', Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Subnet': '1.1', Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Trunk': '1.1'}} Jun 17 10:51:58.146767 dv-cinder-773870-6-iscsi neutron-server[110214]: {{(pid=110214) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jun 17 10:51:58.158118 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:58.367039 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-83b7a7bd-0d49-40d8-82e3-1e4bcf700c49 None None] Provisioning for port eb019455-7660-49c6-956b-e60b632a1b70 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:51:58.370868 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-83b7a7bd-0d49-40d8-82e3-1e4bcf700c49 None None] Provisioning complete for port eb019455-7660-49c6-956b-e60b632a1b70 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:51:58.371257 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-83b7a7bd-0d49-40d8-82e3-1e4bcf700c49 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:58.395931 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:58.407273 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-83b7a7bd-0d49-40d8-82e3-1e4bcf700c49 None None] Port eb019455-7660-49c6-956b-e60b632a1b70 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 10:51:58.583054 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:58.646775 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:58.648123 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7899558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8290591'] for router_interface, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:58.650568 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:51:58.724552 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Pushing event updated for resources: {'Port': ['ID=eb019455-7660-49c6-956b-e60b632a1b70,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:51:58.729091 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:51:58.804561 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Network c9e09c5d-dfd8-4c60-acee-500064545344 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:51:58.806240 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:51:59.038245 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-521d4e5d-5576-49ec-9129-4b72a942c3bb None None] Provisioning complete for port eb019455-7660-49c6-956b-e60b632a1b70 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:51:59.038613 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-521d4e5d-5576-49ec-9129-4b72a942c3bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:51:59.070732 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-521d4e5d-5576-49ec-9129-4b72a942c3bb None None] Port eb019455-7660-49c6-956b-e60b632a1b70 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 10:51:59.121393 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Router f209e704-54d3-448c-9f9c-4ed923402fad is scheduled to L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 with binding_index 1 {{(pid=110214) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} Jun 17 10:51:59.212228 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 10:51:59.217785 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] 10.222.0.41 "PUT /v2.0/routers/f209e704-54d3-448c-9f9c-4ed923402fad/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.2426846 Jun 17 10:51:59.222086 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Sync routers for ids ['f209e704-54d3-448c-9f9c-4ed923402fad'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 10:51:59.236860 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Routers {'f209e704-54d3-448c-9f9c-4ed923402fad'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 10:51:59.237667 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T10:51:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['f209e704-54d3-448c-9f9c-4ed923402fad'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:51:59.418837 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Set router f209e704-54d3-448c-9f9c-4ed923402fad gateway port host: None {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 10:51:59.839100 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'name': 'router1', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:51:47Z', 'updated_at': '2021-06-17T10:51:58Z', 'revision_number': 2, 'project_id': '617d6b16df94411b89a439581740b0bd', 'gw_port_host': None, '_interfaces': [{'id': 'eb019455-7660-49c6-956b-e60b632a1b70', 'name': '', 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'mac_address': 'fa:16:3e:1d:ac:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:51:57Z', 'updated_at': '2021-06-17T10:51:58Z', 'revision_number': 2, 'project_id': '617d6b16df94411b89a439581740b0bd', 'subnets': [{'id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6ffcd63d-66b7-4cf7-83fa-2565b88134bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:51:59.895833 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Checking router: f209e704-54d3-448c-9f9c-4ed923402fad for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 10:51:59.896205 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Updating router f209e704-54d3-448c-9f9c-4ed923402fad port eb019455-7660-49c6-956b-e60b632a1b70 binding host dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 10:51:59.962670 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:00.460080 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Notify callbacks [] for port, precommit_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:00.478400 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.provisioning_blocks [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Transition to ACTIVE for port object eb019455-7660-49c6-956b-e60b632a1b70 will not be triggered until provisioned by entity L2. {{(pid=110218) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:52:00.572500 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:00.577665 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:52:00.718017 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Pushing event updated for resources: {'Port': ['ID=eb019455-7660-49c6-956b-e60b632a1b70,revision_number=3']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:52:00.743972 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.744317 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.745017 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.745328 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.745641 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.745958 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.746374 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.746707 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.747067 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.747384 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.747695 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.748002 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Tracked resource versions report: Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: pushed versions: Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: { 'AddressGroup': {'1.2'}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'ConntrackHelper': {'1.0'}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Log': {'1.0'}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Network': {'1.1'}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Port': {'1.7'}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'PortForwarding': {'1.2'}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'QosPolicy': {'1.8'}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SecurityGroup': {'1.4'}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SecurityGroupRule': {'1.2'}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SubPort': {'1.0'}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Subnet': {'1.1'}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Trunk': {'1.1'}} Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: consumer versions: Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: { DHCP agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: L3 agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: Metadata agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: Metering agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: Open vSwitch agent@dv-cinder-773870-6-iscsi: { 'AddressGroup': '1.2', Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'ConntrackHelper': '1.0', Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Log': '1.0', Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Network': '1.1', Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Port': '1.7', Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'PortForwarding': '1.2', Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'QosPolicy': '1.8', Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SecurityGroup': '1.4', Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SecurityGroupRule': '1.2', Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SubPort': '1.0', Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Subnet': '1.1', Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Trunk': '1.1'}} Jun 17 10:52:00.749159 dv-cinder-773870-6-iscsi neutron-server[110218]: {{(pid=110218) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jun 17 10:52:00.758030 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:52:00.806602 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Attempting to bind port eb019455-7660-49c6-956b-e60b632a1b70 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 10:52:00.807041 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Attempting to bind port eb019455-7660-49c6-956b-e60b632a1b70 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '28b8363e-106d-4984-a657-b73ffa4c27da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344'}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 10:52:00.807482 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Attempting to bind port eb019455-7660-49c6-956b-e60b632a1b70 on network c9e09c5d-dfd8-4c60-acee-500064545344 {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:52:00.812379 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 10, 51, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 10:52:00.812786 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Checking segment: {'id': '28b8363e-106d-4984-a657-b73ffa4c27da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110218) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:52:00.813277 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:00.813703 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Bound using segment: {'id': '28b8363e-106d-4984-a657-b73ffa4c27da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344'} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 10:52:00.814186 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Bound port: eb019455-7660-49c6-956b-e60b632a1b70, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '28b8363e-106d-4984-a657-b73ffa4c27da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344'}}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 10:52:00.814553 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:00.880148 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] For port eb019455-7660-49c6-956b-e60b632a1b70, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110218) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 10:52:00.902034 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] For port eb019455-7660-49c6-956b-e60b632a1b70, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=eb019455-7660-49c6-956b-e60b632a1b70,segment=NetworkSegment(28b8363e-106d-4984-a657-b73ffa4c27da),segment_id=28b8363e-106d-4984-a657-b73ffa4c27da)] {{(pid=110218) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 10:52:00.964145 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:00.967388 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:52:01.011031 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Routers {'f209e704-54d3-448c-9f9c-4ed923402fad'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 10:52:01.011792 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T10:51:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['f209e704-54d3-448c-9f9c-4ed923402fad'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:52:01.094244 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Pushing event updated for resources: {'Port': ['ID=eb019455-7660-49c6-956b-e60b632a1b70,revision_number=4']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:52:01.103360 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:52:01.115211 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] Set router f209e704-54d3-448c-9f9c-4ed923402fad gateway port host: None {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 10:52:01.324077 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'name': 'router1', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:51:47Z', 'updated_at': '2021-06-17T10:51:58Z', 'revision_number': 2, 'project_id': '617d6b16df94411b89a439581740b0bd', 'gw_port_host': None, '_interfaces': [{'id': 'eb019455-7660-49c6-956b-e60b632a1b70', 'name': '', 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'mac_address': 'fa:16:3e:1d:ac:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:51:57Z', 'updated_at': '2021-06-17T10:52:00Z', 'revision_number': 4, 'project_id': '617d6b16df94411b89a439581740b0bd', 'subnets': [{'id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6ffcd63d-66b7-4cf7-83fa-2565b88134bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:52:01.350330 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-234830d6-4acc-406f-b727-eb7014e9a1b4 None None] The sync data for ids ['f209e704-54d3-448c-9f9c-4ed923402fad'] in dv-cinder-773870-6-iscsi is: [{'id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'name': 'router1', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:51:47Z', 'updated_at': '2021-06-17T10:51:58Z', 'revision_number': 2, 'project_id': '617d6b16df94411b89a439581740b0bd', 'gw_port_host': None, '_interfaces': [{'id': 'eb019455-7660-49c6-956b-e60b632a1b70', 'name': '', 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'mac_address': 'fa:16:3e:1d:ac:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:51:57Z', 'updated_at': '2021-06-17T10:52:00Z', 'revision_number': 4, 'project_id': '617d6b16df94411b89a439581740b0bd', 'subnets': [{'id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6ffcd63d-66b7-4cf7-83fa-2565b88134bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 10:52:01.435789 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 57468) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:52:01.547339 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b7104c6-b840-448b-a878-42448f4c4334 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:52:01.548660 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-0b7104c6-b840-448b-a878-42448f4c4334 admin admin] 10.222.0.41 "GET /v2.0/networks/ae4da6f8-a7ac-4884-8d49-a1c679d58f18 HTTP/1.1" status: 200 len: 842 time: 0.1118879 Jun 17 10:52:01.557898 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Request body: {'subnet': {'gateway_ip': '172.27.3.1', 'ip_version': 4, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'enable_dhcp': False, 'cidr': '172.27.3.0/24', 'name': 'public-subnet'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:52:01.559368 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.quota [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Loaded quota_driver: . Jun 17 10:52:01.661251 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Made reservation on behalf of 846a6ac708f34c3a80ec503ab7a66b3a for: {'subnet': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:52:01.663655 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Notify callbacks [] for subnet, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:02.058226 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.objects.ports [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=110214) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}} Jun 17 10:52:02.058758 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485'] for subnet, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:02.061559 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:52:02.120642 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Pushing event updated for resources: {'Subnet': ['ID=f8350199-265a-4724-9d19-42e5cbbe0f87,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:52:02.127168 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:52:02.128316 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Checking segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110214) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:52:02.128655 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Network hostable DHCP agents. Network: ae4da6f8-a7ac-4884-8d49-a1c679d58f18, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110214) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 10:52:02.243529 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110214) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 10:52:02.318218 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, ae4da6f8-a7ac-4884-8d49-a1c679d58f18) {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:52:02.322237 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:52:02.323080 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:02.326730 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e5724b2-dff8-4fa0-a05c-b42128c37647 None None] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:52:02.427020 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8725052 Jun 17 10:52:02.453685 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b101c736-533a-47af-b0ef-7b329d536928 None None] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:52:04.842932 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 57480) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:52:04.988632 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-4e31fde4-2ef7-48f9-9283-92b0b2499200 admin admin] 10.222.0.41 "GET /v2.0/routers/f209e704-54d3-448c-9f9c-4ed923402fad HTTP/1.1" status: 200 len: 710 time: 0.1444283 Jun 17 10:52:05.072630 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-356b10b9-cfdd-445e-9915-552d34e58f41 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:52:05.076659 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-356b10b9-cfdd-445e-9915-552d34e58f41 admin admin] 10.222.0.41 "GET /v2.0/networks/ae4da6f8-a7ac-4884-8d49-a1c679d58f18 HTTP/1.1" status: 200 len: 886 time: 0.0804021 Jun 17 10:52:05.082746 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:52:05.322598 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8287140', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8358552', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2037'] for router, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:05.538265 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device eb019455-7660-49c6-956b-e60b632a1b70 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:52:05.678381 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port eb019455-7660-49c6-956b-e60b632a1b70 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:52:05.682607 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port eb019455-7660-49c6-956b-e60b632a1b70 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:52:05.683037 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:05.756121 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:05.760625 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:05.829906 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:05.860570 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port eb019455-7660-49c6-956b-e60b632a1b70, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=eb019455-7660-49c6-956b-e60b632a1b70,segment=NetworkSegment(28b8363e-106d-4984-a657-b73ffa4c27da),segment_id=28b8363e-106d-4984-a657-b73ffa4c27da)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:52:05.939735 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Allocated IP 172.27.3.31 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/ebd537fb-9fd4-4070-aca3-e93bb551d461) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 10:52:05.969551 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:05.976827 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:52:06.041418 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:06.065695 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=eb019455-7660-49c6-956b-e60b632a1b70,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:52:06.069391 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:52:06.161218 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:06.163651 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:52:06.199051 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:52:06.201760 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:52:06.207154 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 10:52:06.212039 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Pushing event updated for resources: {'Port': ['ID=ebd537fb-9fd4-4070-aca3-e93bb551d461,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:52:06.243671 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:52:06.538262 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:06.726309 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8287140', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8358552', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2037'] for router, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:06.729582 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8287186', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-8287147', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-8287193', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-8358545'] for router, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:06.831897 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Router f209e704-54d3-448c-9f9c-4ed923402fad has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 10:52:06.933173 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 10:52:06.937289 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Notify callbacks [] for router, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:06.938662 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] 10.222.0.41 "PUT /v2.0/routers/f209e704-54d3-448c-9f9c-4ed923402fad HTTP/1.1" status: 200 len: 889 time: 1.8589342 Jun 17 10:52:06.943492 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Sync routers for ids ['f209e704-54d3-448c-9f9c-4ed923402fad'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 10:52:06.955617 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Routers {'f209e704-54d3-448c-9f9c-4ed923402fad'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 10:52:06.956288 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T10:51:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['f209e704-54d3-448c-9f9c-4ed923402fad'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:52:07.168529 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Set router f209e704-54d3-448c-9f9c-4ed923402fad gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 10:52:07.508811 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device eb019455-7660-49c6-956b-e60b632a1b70 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:52:07.596588 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'name': 'router1', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.31'}], 'enable_snat': True}, 'gw_port_id': 'ebd537fb-9fd4-4070-aca3-e93bb551d461', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:51:47Z', 'updated_at': '2021-06-17T10:52:06Z', 'revision_number': 4, 'project_id': '617d6b16df94411b89a439581740b0bd', 'gw_port': {'id': 'ebd537fb-9fd4-4070-aca3-e93bb551d461', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:cd:f3:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.31', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:52:05Z', 'updated_at': '2021-06-17T10:52:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'eb019455-7660-49c6-956b-e60b632a1b70', 'name': '', 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'mac_address': 'fa:16:3e:1d:ac:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:51:57Z', 'updated_at': '2021-06-17T10:52:05Z', 'revision_number': 5, 'project_id': '617d6b16df94411b89a439581740b0bd', 'subnets': [{'id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6ffcd63d-66b7-4cf7-83fa-2565b88134bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:52:07.621958 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port eb019455-7660-49c6-956b-e60b632a1b70 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:52:07.622323 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:07.651439 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Checking router: f209e704-54d3-448c-9f9c-4ed923402fad for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 10:52:07.651786 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Updating router f209e704-54d3-448c-9f9c-4ed923402fad port ebd537fb-9fd4-4070-aca3-e93bb551d461 binding host dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 10:52:07.711159 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:08.053584 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Notify callbacks [] for port, precommit_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:08.062677 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Transition to ACTIVE for port object ebd537fb-9fd4-4070-aca3-e93bb551d461 will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:52:08.140945 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:08.143369 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-50e5fabe-c9c7-409b-9149-259b5816e607 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:52:08.196273 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Attempting to bind port ebd537fb-9fd4-4070-aca3-e93bb551d461 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 10:52:08.196636 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Attempting to bind port ebd537fb-9fd4-4070-aca3-e93bb551d461 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 10:52:08.196992 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Attempting to bind port ebd537fb-9fd4-4070-aca3-e93bb551d461 on network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:52:08.198908 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bc640d6-519f-47dc-b8b1-c86ac1a631ea None None] Pushing event updated for resources: {'Port': ['ID=ebd537fb-9fd4-4070-aca3-e93bb551d461,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:52:08.202206 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-5bc640d6-519f-47dc-b8b1-c86ac1a631ea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:52:08.204918 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 10, 51, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 10:52:08.205294 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Checking segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:52:08.205689 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:08.206071 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Bound using segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 10:52:08.206534 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Bound port: ebd537fb-9fd4-4070-aca3-e93bb551d461, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 10:52:08.206943 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:08.334773 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] For port ebd537fb-9fd4-4070-aca3-e93bb551d461, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 10:52:08.337595 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] For port ebd537fb-9fd4-4070-aca3-e93bb551d461, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=ebd537fb-9fd4-4070-aca3-e93bb551d461,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 10:52:08.438425 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:08.440767 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:52:08.494638 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bc640d6-519f-47dc-b8b1-c86ac1a631ea None None] Pushing event updated for resources: {'Port': ['ID=ebd537fb-9fd4-4070-aca3-e93bb551d461,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:52:08.497626 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Routers {'f209e704-54d3-448c-9f9c-4ed923402fad'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 10:52:08.498064 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T10:51:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['f209e704-54d3-448c-9f9c-4ed923402fad'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:52:08.499969 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-5bc640d6-519f-47dc-b8b1-c86ac1a631ea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:52:08.602070 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] Set router f209e704-54d3-448c-9f9c-4ed923402fad gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 10:52:08.810456 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'name': 'router1', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.31'}], 'enable_snat': True}, 'gw_port_id': 'ebd537fb-9fd4-4070-aca3-e93bb551d461', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:51:47Z', 'updated_at': '2021-06-17T10:52:06Z', 'revision_number': 4, 'project_id': '617d6b16df94411b89a439581740b0bd', 'gw_port': {'id': 'ebd537fb-9fd4-4070-aca3-e93bb551d461', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:cd:f3:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.31', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:52:05Z', 'updated_at': '2021-06-17T10:52:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'eb019455-7660-49c6-956b-e60b632a1b70', 'name': '', 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'mac_address': 'fa:16:3e:1d:ac:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:51:57Z', 'updated_at': '2021-06-17T10:52:05Z', 'revision_number': 5, 'project_id': '617d6b16df94411b89a439581740b0bd', 'subnets': [{'id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6ffcd63d-66b7-4cf7-83fa-2565b88134bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:52:08.837147 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58413d5f-1051-4dcf-868b-b7dfc5346bea None None] The sync data for ids ['f209e704-54d3-448c-9f9c-4ed923402fad'] in dv-cinder-773870-6-iscsi is: [{'id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'name': 'router1', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.31'}], 'enable_snat': True}, 'gw_port_id': 'ebd537fb-9fd4-4070-aca3-e93bb551d461', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:51:47Z', 'updated_at': '2021-06-17T10:52:06Z', 'revision_number': 4, 'project_id': '617d6b16df94411b89a439581740b0bd', 'gw_port': {'id': 'ebd537fb-9fd4-4070-aca3-e93bb551d461', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:cd:f3:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.31', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:52:05Z', 'updated_at': '2021-06-17T10:52:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'eb019455-7660-49c6-956b-e60b632a1b70', 'name': '', 'network_id': 'c9e09c5d-dfd8-4c60-acee-500064545344', 'tenant_id': '617d6b16df94411b89a439581740b0bd', 'mac_address': 'fa:16:3e:1d:ac:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f209e704-54d3-448c-9f9c-4ed923402fad', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:51:57Z', 'updated_at': '2021-06-17T10:52:05Z', 'revision_number': 5, 'project_id': '617d6b16df94411b89a439581740b0bd', 'subnets': [{'id': '5c44281f-05c8-4726-ba59-2f0f3848e0a7', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6ffcd63d-66b7-4cf7-83fa-2565b88134bf'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 10:52:09.320397 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 57488) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:52:09.454716 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-952ba288-9d40-4a46-8d2b-60f3e07f7ab9 admin admin] 10.222.0.41 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1318293 Jun 17 10:52:09.558591 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device ebd537fb-9fd4-4070-aca3-e93bb551d461 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:52:09.675021 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port ebd537fb-9fd4-4070-aca3-e93bb551d461 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:52:09.679128 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port ebd537fb-9fd4-4070-aca3-e93bb551d461 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:52:09.679511 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:09.760094 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:09.783408 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port ebd537fb-9fd4-4070-aca3-e93bb551d461, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=ebd537fb-9fd4-4070-aca3-e93bb551d461,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:52:09.872516 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:09.879184 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-5bc640d6-519f-47dc-b8b1-c86ac1a631ea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:52:09.924141 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=ebd537fb-9fd4-4070-aca3-e93bb551d461,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:52:09.927360 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:52:11.518156 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device ebd537fb-9fd4-4070-aca3-e93bb551d461 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:52:11.574253 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port ebd537fb-9fd4-4070-aca3-e93bb551d461 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:52:11.574632 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:20.605869 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-65cf48ea-7c74-4714-9463-b85169f14b30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:23.050187 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 5 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:52:23.316295 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d90498a5-b188-41d3-9a29-8be38aab071e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:23.537407 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:24.381194 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:26.725796 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:50.594738 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-204b0858-2e55-473c-b8f5-d85acaa6aa9b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:53.710360 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-021e9921-c959-43e9-a328-9281af52ad99 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:53.719103 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:54.370702 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:52:56.725078 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:00.049240 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 5 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:53:20.586907 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-18e5826d-ab1f-4b16-ae6e-2fb1cb43685a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:23.346660 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-e3d8c55d-6954-42cc-afa6-f82bb29b4610 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:23.669491 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:24.378071 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:26.732535 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:37.048879 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 5 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:53:47.506808 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58056) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:53:47.570043 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.pecan_wsgi.hooks.translation [None req-a2b9a38a-a2a2-4d8d-a93a-2e1169a71a98 admin admin] GET failed (client error): The resource could not be found. Jun 17 10:53:47.571450 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-a2b9a38a-a2a2-4d8d-a93a-2e1169a71a98 admin admin] 10.222.0.41 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0636673 Jun 17 10:53:47.736080 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e62bdd5b-9292-4e8a-986d-8ad45bc656c5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:53:47.737629 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-e62bdd5b-9292-4e8a-986d-8ad45bc656c5 admin admin] 10.222.0.41 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1617248 Jun 17 10:53:49.878614 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58066) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:53:49.971450 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab668b54-0e76-442f-9094-eed67b8cff9f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:53:49.972746 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-ab668b54-0e76-442f-9094-eed67b8cff9f admin admin] 10.222.0.41 "GET /v2.0/subnets/5c44281f-05c8-4726-ba59-2f0f3848e0a7 HTTP/1.1" status: 200 len: 849 time: 0.0932093 Jun 17 10:53:49.982451 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:53:50.067106 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Notify callbacks [] for subnet, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:50.266073 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8743358265456'] for subnet, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:50.269175 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c6a7f18c-6d17-4ad9-af29-9c296c2589eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:53:50.301804 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:53:50.302374 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:50.303657 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] 10.222.0.41 "PUT /v2.0/subnets/5c44281f-05c8-4726-ba59-2f0f3848e0a7 HTTP/1.1" status: 200 len: 868 time: 0.3254826 Jun 17 10:53:50.308574 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-76ce5678-a087-4444-b619-63a109b673f3 None None] Network c9e09c5d-dfd8-4c60-acee-500064545344 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:53:50.328651 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Pushing event updated for resources: {'Subnet': ['ID=5c44281f-05c8-4726-ba59-2f0f3848e0a7,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:53:50.336503 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.336821 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.337165 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.337489 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.337812 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.338156 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.338477 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.338809 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.339174 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.339491 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.339806 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.340171 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:53:50.343855 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:53:50.594442 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-babd4e4e-0903-440d-ab7e-04e790faeb63 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:50.728658 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-41cf3f7b-c288-42ed-9ffc-5d7746504de2 None None] Provisioning complete for port eb019455-7660-49c6-956b-e60b632a1b70 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:53:50.729033 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-41cf3f7b-c288-42ed-9ffc-5d7746504de2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:50.813086 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-41cf3f7b-c288-42ed-9ffc-5d7746504de2 None None] Provisioning complete for port e91ddbc4-59e8-47d8-99c7-25ea402af786 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:53:50.813342 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-41cf3f7b-c288-42ed-9ffc-5d7746504de2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:52.463823 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58076) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:53:52.661060 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14c9c3e2-7938-48be-9ce5-e5151ab947f6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:53:52.661450 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14c9c3e2-7938-48be-9ce5-e5151ab947f6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:53:52.662965 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-14c9c3e2-7938-48be-9ce5-e5151ab947f6 admin admin] 10.222.0.41 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1981668 Jun 17 10:53:53.323094 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-5714dd73-1e71-4572-a8c5-db9858650610 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:53.548215 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:54.388755 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:54.798659 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58084) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:53:54.928128 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f1d8e60-9f48-4f8b-8659-802712bf08f9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:53:54.928652 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f1d8e60-9f48-4f8b-8659-802712bf08f9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:53:54.930293 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-8f1d8e60-9f48-4f8b-8659-802712bf08f9 admin admin] 10.222.0.41 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1305418 Jun 17 10:53:56.719549 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:53:57.053851 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58092) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:53:57.203775 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6d13592-0f88-4259-b943-855417ed77aa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:53:57.205129 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f6d13592-0f88-4259-b943-855417ed77aa admin admin] 10.222.0.41 "GET /v2.0/networks/ae4da6f8-a7ac-4884-8d49-a1c679d58f18 HTTP/1.1" status: 200 len: 886 time: 0.1503150 Jun 17 10:53:59.375736 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58100) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:53:59.579762 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0ebe145-20c4-494f-a049-cb252a90a851 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:53:59.581126 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-b0ebe145-20c4-494f-a049-cb252a90a851 admin admin] 10.222.0.41 "GET /v2.0/networks/c9e09c5d-dfd8-4c60-acee-500064545344 HTTP/1.1" status: 200 len: 869 time: 0.2043211 Jun 17 10:54:01.706214 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58108) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:54:01.824155 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-805c2522-8fd8-4298-b9c3-03562011aea8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:54:01.824606 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-805c2522-8fd8-4298-b9c3-03562011aea8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:54:01.826126 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-805c2522-8fd8-4298-b9c3-03562011aea8 admin admin] 10.222.0.41 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1189055 Jun 17 10:54:03.968910 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58116) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:54:04.061057 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e41fe5a-1147-4299-b850-4618d581b2ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:54:04.061511 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e41fe5a-1147-4299-b850-4618d581b2ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:54:04.063023 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-8e41fe5a-1147-4299-b850-4618d581b2ff admin admin] 10.222.0.41 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0931511 Jun 17 10:54:06.215991 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58124) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:54:06.304891 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4cd804f-82b4-4392-9c6d-6000cbc7d51f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:54:06.306199 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-d4cd804f-82b4-4392-9c6d-6000cbc7d51f admin admin] 10.222.0.41 "GET /v2.0/subnets/5c44281f-05c8-4726-ba59-2f0f3848e0a7 HTTP/1.1" status: 200 len: 868 time: 0.0892701 Jun 17 10:54:08.432653 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58132) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:54:08.517737 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-411b2cf9-0545-4ce6-92f0-199d70eff2d5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:54:08.519076 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-411b2cf9-0545-4ce6-92f0-199d70eff2d5 admin admin] 10.222.0.41 "GET /v2.0/subnets/f8350199-265a-4724-9d19-42e5cbbe0f87 HTTP/1.1" status: 200 len: 816 time: 0.0849180 Jun 17 10:54:14.049312 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 5 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:54:20.625022 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8a2f2ea7-365c-4531-a9e1-428615c5a701 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:23.295765 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-bcb2c563-3bab-484e-a16a-4afe2ffd03b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:23.559058 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:24.404411 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:26.744980 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:31.903870 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58176) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:54:31.949430 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [None req-669e934f-4acc-4ce3-9002-6c5461324b37 admin admin] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110215) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 10:54:31.950493 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-669e934f-4acc-4ce3-9002-6c5461324b37 admin admin] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0457597 Jun 17 10:54:34.192696 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58184) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:54:34.250615 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.pecan_wsgi.hooks.translation [None req-79430a46-42d0-4852-abfe-936b37554da9 admin admin] GET failed (client error): The resource could not be found. Jun 17 10:54:34.251928 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-79430a46-42d0-4852-abfe-936b37554da9 admin admin] 10.222.0.41 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0582995 Jun 17 10:54:34.389948 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91390cda-cf41-42b7-9380-5c4739548b77 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:54:34.391354 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-91390cda-cf41-42b7-9380-5c4739548b77 admin admin] 10.222.0.41 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1352601 Jun 17 10:54:36.539579 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58192) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:54:36.587323 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Request body: {'network': {'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:54:36.676554 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Made reservation on behalf of 846a6ac708f34c3a80ec503ab7a66b3a for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:54:36.678347 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:36.719637 dv-cinder-773870-6-iscsi neutron-server[110215]: WARNING neutron.services.revisions.revision_plugin [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Could not find related network for resource to bump revision. Jun 17 10:54:36.731232 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] vlan segment allocate from pool success with {'vlan_id': 111, 'physical_network': 'physnet1'} {{(pid=110215) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 10:54:36.740596 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:36.744421 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Added segment c93a3072-686e-4699-8753-4cd5b8316f3d of type vlan for network f346e9b2-9fe2-4af1-8380-b232a75b9a13 Jun 17 10:54:36.836081 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:36.929990 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:36.932076 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:54:36.932681 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:36.934814 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-82217cb3-df1d-4a97-bfe0-834621eb9c52 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:54:36.989570 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Pushing event updated for resources: {'Network': ['ID=f346e9b2-9fe2-4af1-8380-b232a75b9a13,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:54:36.992206 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:54:37.000864 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network f346e9b2-9fe2-4af1-8380-b232a75b9a13 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 10:54:37.033821 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4930582 Jun 17 10:54:39.236011 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58200) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:54:39.300275 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.pecan_wsgi.hooks.translation [None req-48917c0e-f7af-48d3-89ee-8cd015c86b28 admin admin] GET failed (client error): The resource could not be found. Jun 17 10:54:39.301655 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-48917c0e-f7af-48d3-89ee-8cd015c86b28 admin admin] 10.222.0.41 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0644541 Jun 17 10:54:39.372059 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9fd9b370-0cea-482e-97b6-5429ec395e8c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:54:39.373521 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-9fd9b370-0cea-482e-97b6-5429ec395e8c admin admin] 10.222.0.41 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0664988 Jun 17 10:54:39.383582 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Request body: {'subnet': {'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13', 'name': 'shared-subnet', 'ip_version': 4, 'description': 'shared-subnet', 'cidr': '192.168.233.0/24'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:54:39.472179 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Made reservation on behalf of 846a6ac708f34c3a80ec503ab7a66b3a for: {'subnet': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:54:39.474394 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Notify callbacks [] for subnet, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:39.713183 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485'] for subnet, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:39.715523 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:54:39.768350 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bae7e2b1-4280-43ce-b1d4-41ed17f002e7,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:54:39.771571 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:54:39.777438 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Checking segment: {'id': 'c93a3072-686e-4699-8753-4cd5b8316f3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:54:39.777794 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Network hostable DHCP agents. Network: f346e9b2-9fe2-4af1-8380-b232a75b9a13, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110215) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 10:54:39.849240 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Network f346e9b2-9fe2-4af1-8380-b232a75b9a13 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110215) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 10:54:39.918238 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, f346e9b2-9fe2-4af1-8380-b232a75b9a13) {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:54:39.922732 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:54:39.927160 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:39.928182 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c02648fa-b9b4-43f2-bc97-17bcf18ffd45 None None] Network f346e9b2-9fe2-4af1-8380-b232a75b9a13 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:54:40.004731 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6248374 Jun 17 10:54:40.221845 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5498e9f9-7e24-5c53-b771-9493a76e3e58-f346e9b2-9fe2-4af1-8380-b232a75b9a13', 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13', 'tenant_id': '846a6ac708f34c3a80ec503ab7a66b3a', 'fixed_ips': [{'subnet_id': 'bae7e2b1-4280-43ce-b1d4-41ed17f002e7'}]}} from dv-cinder-773870-6-iscsi. {{(pid=110216) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Jun 17 10:54:40.222833 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:40.373681 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.db_base_plugin_common [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Allocated IP 192.168.233.2 (f346e9b2-9fe2-4af1-8380-b232a75b9a13/bae7e2b1-4280-43ce-b1d4-41ed17f002e7/4b82f21b-d208-4eec-abdd-37e26847e22b) {{(pid=110216) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 10:54:40.609038 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Notify callbacks [] for port, precommit_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:40.618081 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Transition to ACTIVE for port object 4b82f21b-d208-4eec-abdd-37e26847e22b will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:54:40.633328 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Transition to ACTIVE for port object 4b82f21b-d208-4eec-abdd-37e26847e22b will not be triggered until provisioned by entity DHCP. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:54:40.747012 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:40.749275 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:54:40.790743 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Pushing event updated for resources: {'Port': ['ID=4b82f21b-d208-4eec-abdd-37e26847e22b,revision_number=1']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:54:40.814611 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.815001 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.815349 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.815682 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.816010 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.816337 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.816672 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.816977 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.817314 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.817637 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.817956 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.818268 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:54:40.824690 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:54:40.829732 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Network f346e9b2-9fe2-4af1-8380-b232a75b9a13 is already hosted by enough agents. {{(pid=110216) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:54:40.831182 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.base_scheduler [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Resources bound (agent type, host, resource id): {{(pid=110216) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:54:40.833649 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Received port after_create {{(pid=110216) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 10:54:40.893903 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Attempting to bind port 4b82f21b-d208-4eec-abdd-37e26847e22b on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 10:54:40.894185 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Attempting to bind port 4b82f21b-d208-4eec-abdd-37e26847e22b by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': 'c93a3072-686e-4699-8753-4cd5b8316f3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 10:54:40.894543 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Attempting to bind port 4b82f21b-d208-4eec-abdd-37e26847e22b on network f346e9b2-9fe2-4af1-8380-b232a75b9a13 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:54:40.900288 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 10, 54, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 10:54:40.901569 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Checking segment: {'id': 'c93a3072-686e-4699-8753-4cd5b8316f3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:54:40.901569 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:40.901569 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Bound using segment: {'id': 'c93a3072-686e-4699-8753-4cd5b8316f3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 10:54:40.901943 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Bound port: 4b82f21b-d208-4eec-abdd-37e26847e22b, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c93a3072-686e-4699-8753-4cd5b8316f3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 10:54:40.902314 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:40.967509 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] For port 4b82f21b-d208-4eec-abdd-37e26847e22b, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 10:54:40.970671 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] For port 4b82f21b-d208-4eec-abdd-37e26847e22b, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=4b82f21b-d208-4eec-abdd-37e26847e22b,segment=NetworkSegment(c93a3072-686e-4699-8753-4cd5b8316f3d),segment_id=c93a3072-686e-4699-8753-4cd5b8316f3d)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 10:54:41.044041 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:41.046405 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:54:41.107734 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Pushing event updated for resources: {'Port': ['ID=4b82f21b-d208-4eec-abdd-37e26847e22b,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:54:41.112241 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:54:41.747990 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 4b82f21b-d208-4eec-abdd-37e26847e22b up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:54:41.878115 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 4b82f21b-d208-4eec-abdd-37e26847e22b completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:54:41.932713 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-795e7780-0569-4399-8f87-aeb0c560ffa0 None None] Network f346e9b2-9fe2-4af1-8380-b232a75b9a13 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:54:42.094379 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-860a9c24-6dfe-4f30-a549-f9005161ab0a None None] Provisioning for port 4b82f21b-d208-4eec-abdd-37e26847e22b completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:54:42.100168 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-860a9c24-6dfe-4f30-a549-f9005161ab0a None None] Provisioning complete for port 4b82f21b-d208-4eec-abdd-37e26847e22b triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:54:42.100535 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-860a9c24-6dfe-4f30-a549-f9005161ab0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:42.202596 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-860a9c24-6dfe-4f30-a549-f9005161ab0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:42.240826 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-860a9c24-6dfe-4f30-a549-f9005161ab0a None None] For port 4b82f21b-d208-4eec-abdd-37e26847e22b, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=4b82f21b-d208-4eec-abdd-37e26847e22b,segment=NetworkSegment(c93a3072-686e-4699-8753-4cd5b8316f3d),segment_id=c93a3072-686e-4699-8753-4cd5b8316f3d)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:54:42.312645 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-860a9c24-6dfe-4f30-a549-f9005161ab0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:42.314577 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:54:42.362569 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860a9c24-6dfe-4f30-a549-f9005161ab0a None None] Pushing event updated for resources: {'Port': ['ID=4b82f21b-d208-4eec-abdd-37e26847e22b,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:54:42.365551 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-860a9c24-6dfe-4f30-a549-f9005161ab0a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:54:42.436460 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-0885f1f3-675a-493d-a5e9-4447e776bcac None None] Provisioning complete for port 4b82f21b-d208-4eec-abdd-37e26847e22b triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:54:42.436869 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-0885f1f3-675a-493d-a5e9-4447e776bcac None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:43.721505 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 4b82f21b-d208-4eec-abdd-37e26847e22b up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:54:43.774545 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 4b82f21b-d208-4eec-abdd-37e26847e22b triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:54:43.775107 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:50.629755 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-eb8b9bba-1bd1-40e9-9ba2-92636ad790c0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:51.047669 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 5 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:54:53.305678 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-57e4c0f5-ef13-4e3e-bbdc-c5a650e657fd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:53.534185 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:54.386095 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:54:56.728963 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:20.608050 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1964a95f-991d-4b78-83da-f31a9faec2cf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:23.287723 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-c769656d-93e8-4ba9-84d3-0d306d756dea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:23.550671 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:24.382601 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:26.727484 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:28.047763 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 5 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:55:50.610362 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-5c60db6b-7381-414e-a202-05c183f96f50 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:53.320591 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-4a3e1e70-d707-446f-ad48-c6f759dfa8f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:53.532076 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:54.451723 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:56.741615 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:57.488601 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58252) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:55:57.494525 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [None req-bd9f3c21-1bc2-4738-abf1-b56ef0fb3454 tempest-verify_tempest_config-980704182 tempest-verify_tempest_config-980704182-project] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110215) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 10:55:57.495511 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-bd9f3c21-1bc2-4738-abf1-b56ef0fb3454 tempest-verify_tempest_config-980704182 tempest-verify_tempest_config-980704182-project] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0059359 Jun 17 10:55:58.036797 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58270) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:55:58.141669 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:58.225134 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:58.370532 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:58.374286 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:55:58.417812 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=4a93dde93e72450dbbfdb0fa5c511079&name=default HTTP/1.1" status: 200 len: 2975 time: 0.3799858 Jun 17 10:55:58.418492 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2d3b172-96d1-460e-8213-a556ff6d804b,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:55:58.421277 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58274) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:55:58.426227 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.426580 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.426942 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.427268 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.427596 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.427939 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.428272 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.428575 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.428892 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.429199 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.429506 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.429809 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.433697 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:55:58.496136 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:58.516537 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:58.657743 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:58.661317 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:55:58.662864 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/c2d3b172-96d1-460e-8213-a556ff6d804b HTTP/1.1" status: 204 len: 168 time: 0.2404699 Jun 17 10:55:58.670778 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:55:58.675818 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2d3b172-96d1-460e-8213-a556ff6d804b,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:55:58.687375 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.688851 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.688851 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.688851 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.689322 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.689322 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.689735 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.690071 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.690432 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.690747 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.691099 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.691532 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:55:58.695119 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:56:05.046832 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 5 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:56:20.634094 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-19ec1db1-ee6c-4bfc-b374-349c5195fa4c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:56:23.307956 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-37cef679-ce63-426e-a650-9b6f61ac14bb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:56:23.530762 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:56:24.417086 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:56:26.740529 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:56:42.046392 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 5 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:56:50.648812 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6c466626-4fac-45fc-80c0-5e7b0c70b005 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:56:53.313100 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-91ca1f96-a12e-4497-a716-44f1a963feb4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:56:53.552212 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:56:54.413745 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:56:56.740761 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:57:19.045336 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 5 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:57:20.647673 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8237fc0d-3b84-4fab-b6ff-2cfd2ef5f859 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:57:23.322718 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3cc825e3-7019-46ef-a870-16bc6ce190b1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:57:23.516792 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:57:24.390981 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:57:26.755443 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:57:34.435167 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143'] for agent, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:57:37.905301 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58328) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:57:38.007273 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-ed063324-eef0-4ab8-8f3a-b1017ed9eb60 admin admin] 10.222.0.41 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.1008551 Jun 17 10:57:40.170084 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58338) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:57:40.225441 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-7dc19e6e-972f-4561-8420-7941ad8842e1 admin admin] 10.222.0.41 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.0542052 Jun 17 10:57:50.618285 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8b51f820-0d0e-435d-809f-2d651c785f9f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:57:53.304219 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a2702902-e0f3-4ff2-91d6-d519eff96b91 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:57:53.544195 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:57:54.401861 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:57:56.046796 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:57:56.771347 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:04.361321 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:20.611270 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-17d4ed5b-bb0a-497b-9be8-c5b500b411dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:23.320118 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9da332f4-32d1-4a00-b5c4-f9f6f79326f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:23.537225 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:24.400051 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:26.754555 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:33.047934 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:58:34.364491 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:50.610055 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-60807a4a-c7df-4f5d-8889-906617d6681c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:53.389198 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-5b7fc6bb-a2fd-4a82-a9fc-c1e73b2f1699 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:53.540347 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:54.393407 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:58:56.752901 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:04.359246 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:09.401347 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58524) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:09.651003 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-785670026-network', 'tenant_id': '5a3d5a50b1194ca594e398fd941cbe5f'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:09.760532 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Made reservation on behalf of 5a3d5a50b1194ca594e398fd941cbe5f for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:09.767222 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:09.778302 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:09.890433 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:09.987977 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:09.991345 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:10.017953 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:10.023640 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] vlan segment allocate from pool success with {'vlan_id': 146, 'physical_network': 'physnet1'} {{(pid=110215) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 10:59:10.032239 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.032575 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.032923 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.034329 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.034329 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.034329 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.034329 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.034702 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.034918 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.035232 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.035555 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.035839 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Tracked resource versions report: Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: pushed versions: Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: { 'AddressGroup': {'1.2'}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'ConntrackHelper': {'1.0'}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Log': {'1.0'}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Network': {'1.1'}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Port': {'1.7'}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'PortForwarding': {'1.2'}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'QosPolicy': {'1.8'}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SecurityGroup': {'1.4'}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SecurityGroupRule': {'1.2'}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SubPort': {'1.0'}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Subnet': {'1.1'}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Trunk': {'1.1'}} Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: consumer versions: Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: { DHCP agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: HyperV agent@hv-cinder-77387: {}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: L3 agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: Metadata agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: Metering agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: Open vSwitch agent@dv-cinder-773870-6-iscsi: { 'AddressGroup': '1.2', Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'ConntrackHelper': '1.0', Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Log': '1.0', Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Network': '1.1', Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Port': '1.7', Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'PortForwarding': '1.2', Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'QosPolicy': '1.8', Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SecurityGroup': '1.4', Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SecurityGroupRule': '1.2', Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'SubPort': '1.0', Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Subnet': '1.1', Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: 'Trunk': '1.1'}} Jun 17 10:59:10.036884 dv-cinder-773870-6-iscsi neutron-server[110215]: {{(pid=110215) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jun 17 10:59:10.042841 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:10.051565 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:10.052091 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Added segment f32f5ed9-539a-457e-8330-d3310fcdf7eb of type vlan for network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b Jun 17 10:59:10.053047 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:59:10.098209 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:10.264046 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:10.265953 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:10.266609 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:10.312398 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-412e1597-6ade-4892-a72f-461af75ae55d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:10.330876 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Pushing event updated for resources: {'Network': ['ID=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:10.333791 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:10.341426 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 10:59:10.442541 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58564) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:10.451104 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.0422699 Jun 17 10:59:10.451958 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Request body: {'subnet': {'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-785670026-subnet', 'tenant_id': '5a3d5a50b1194ca594e398fd941cbe5f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:10.522462 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58572) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:10.541788 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Made reservation on behalf of 5a3d5a50b1194ca594e398fd941cbe5f for: {'subnet': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:10.543657 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Notify callbacks [] for subnet, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:10.563584 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58576) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:10.778724 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-584412811-network', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:10.803808 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485'] for subnet, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:10.810150 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:10.818687 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1690088442-network', 'tenant_id': '95dd44ce5be843a295db7140aba1fb25'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:10.867568 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Checking segment: {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110214) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:10.868009 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Network hostable DHCP agents. Network: bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110214) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 10:59:10.880729 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Made reservation on behalf of f15e97a8adc74580bf4df14ed664fc3f for: {'network': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:10.883253 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:10.899375 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:10.915008 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Pushing event updated for resources: {'Subnet': ['ID=c10bc074-5591-4fbf-953f-e4097d48cc79,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:10.923186 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.923553 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.923889 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.924214 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.924533 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.924866 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.925187 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.925515 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.925847 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.926160 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.926468 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.926777 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Tracked resource versions report: Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: pushed versions: Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: { 'AddressGroup': {'1.2'}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'ConntrackHelper': {'1.0'}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Log': {'1.0'}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Network': {'1.1'}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Port': {'1.7'}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'PortForwarding': {'1.2'}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'QosPolicy': {'1.8'}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SecurityGroup': {'1.4'}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SecurityGroupRule': {'1.2'}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SubPort': {'1.0'}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Subnet': {'1.1'}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Trunk': {'1.1'}} Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: consumer versions: Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: { DHCP agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: HyperV agent@hv-cinder-77387: {}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: L3 agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: Metadata agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: Metering agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: Open vSwitch agent@dv-cinder-773870-6-iscsi: { 'AddressGroup': '1.2', Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'ConntrackHelper': '1.0', Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Log': '1.0', Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Network': '1.1', Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Port': '1.7', Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'PortForwarding': '1.2', Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'QosPolicy': '1.8', Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SecurityGroup': '1.4', Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SecurityGroupRule': '1.2', Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'SubPort': '1.0', Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Subnet': '1.1', Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: 'Trunk': '1.1'}} Jun 17 10:59:10.927892 dv-cinder-773870-6-iscsi neutron-server[110214]: {{(pid=110214) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jun 17 10:59:10.931445 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:10.975061 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Made reservation on behalf of 95dd44ce5be843a295db7140aba1fb25 for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:10.977536 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:10.986761 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:10.989440 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110214) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 10:59:11.071626 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.073339 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b) {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:11.077122 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:11.077705 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.084536 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fa0d4b7-689e-44f3-999e-02598415374a None None] Network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:11.159694 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.163221 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2db11668-c6ba-44a3-8cd3-b7e6047568d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:11.201575 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] vlan segment allocate from pool success with {'vlan_id': 126, 'physical_network': 'physnet1'} {{(pid=110214) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 10:59:11.217053 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84a85e25-ad7a-4f18-b88e-f313010f982b,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:11.224990 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:11.227896 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8743358330152', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.228681 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Unsubscribe: segment precommit_create {{(pid=110214) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Jun 17 10:59:11.229017 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.segments_db [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Added segment 0b3760d5-4271-497d-a20f-fec4d6ed355c of type vlan for network 54973ccd-0b2b-4517-ad28-76a3128a2da3 Jun 17 10:59:11.249820 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.8059063 Jun 17 10:59:11.297985 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.298968 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c357851-2bdd-4089-b1b0-5fc3dfd36834 None None] Network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:11.454333 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.461931 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.464791 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:11.465566 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.470066 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:11.512771 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.527282 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-331047f2-6cee-4bf2-aae3-7d27fc2e7e17 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:11.537402 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=110215) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 10:59:11.562270 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.562819 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Added segment 12145aeb-cad3-4041-a8a6-2c52a27c3eb7 of type vlan for network e30545f7-6269-420b-a870-c56fe4fa7478 Jun 17 10:59:11.586676 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Pushing event updated for resources: {'Network': ['ID=54973ccd-0b2b-4517-ad28-76a3128a2da3,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:11.590752 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:11.598642 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network 54973ccd-0b2b-4517-ad28-76a3128a2da3 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 10:59:11.610065 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a32e6c4a-e4f9-4a92-a11f-19134c896927,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:11.615681 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.671132 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:11.679086 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 1.1568818 Jun 17 10:59:11.682035 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58618) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:11.687959 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Request body: {'subnet': {'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-584412811-subnet', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:11.770251 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.771641 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:11.772220 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.774981 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:11.838486 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Made reservation on behalf of f15e97a8adc74580bf4df14ed664fc3f for: {'subnet': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:11.840809 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Notify callbacks [] for subnet, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:11.842863 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Pushing event updated for resources: {'Network': ['ID=e30545f7-6269-420b-a870-c56fe4fa7478,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:11.854423 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network e30545f7-6269-420b-a870-c56fe4fa7478 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 10:59:11.854888 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:11.992239 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.4313595 Jun 17 10:59:11.992531 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58634) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:11.998679 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Request body: {'subnet': {'network_id': 'e30545f7-6269-420b-a870-c56fe4fa7478', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1690088442-subnet', 'tenant_id': '95dd44ce5be843a295db7140aba1fb25', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:12.114265 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485'] for subnet, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:12.115672 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Made reservation on behalf of 95dd44ce5be843a295db7140aba1fb25 for: {'subnet': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:12.121900 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Notify callbacks [] for subnet, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:12.134547 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bc89b7db-0a74-44f9-93f3-463019f6a5ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:12.206075 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b70c69a2-cf24-49e5-90dd-a210bd42e6bb,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:12.212483 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:12.213921 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Checking segment: {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:12.214444 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Network hostable DHCP agents. Network: 54973ccd-0b2b-4517-ad28-76a3128a2da3, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110215) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 10:59:12.301364 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Network 54973ccd-0b2b-4517-ad28-76a3128a2da3 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110215) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 10:59:12.375240 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, 54973ccd-0b2b-4517-ad28-76a3128a2da3) {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:12.380058 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:12.381176 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:12.389411 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35c88827-98e9-4991-9a65-650297a9953a None None] Network 54973ccd-0b2b-4517-ad28-76a3128a2da3 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:12.438398 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485'] for subnet, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:12.448335 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-bb4015de-d273-45cb-95e7-cb5f5e00959c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:12.467688 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.7843854 Jun 17 10:59:12.470105 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58664) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:12.480066 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:12.570111 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Checking segment: {'id': '12145aeb-cad3-4041-a8a6-2c52a27c3eb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'e30545f7-6269-420b-a870-c56fe4fa7478'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110214) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:12.571223 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Network hostable DHCP agents. Network: e30545f7-6269-420b-a870-c56fe4fa7478, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110214) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 10:59:12.585323 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Pushing event updated for resources: {'Subnet': ['ID=556ccdca-d712-410a-a954-c43564443811,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:12.601565 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:12.618120 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8358582', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1816'] for router, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:12.620999 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8357919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8287158', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-8346348', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2019'] for router, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:12.664302 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5498e9f9-7e24-5c53-b771-9493a76e3e58-54973ccd-0b2b-4517-ad28-76a3128a2da3', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb'}]}} from dv-cinder-773870-6-iscsi. {{(pid=110216) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Jun 17 10:59:12.665906 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:12.697375 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Network e30545f7-6269-420b-a870-c56fe4fa7478 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110214) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 10:59:12.735080 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:12.780614 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, e30545f7-6269-420b-a870-c56fe4fa7478) {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:12.784690 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:12.785248 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:12.795752 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2f90609-949d-43b3-a0bc-ea08b2ef4c89 None None] Network e30545f7-6269-420b-a870-c56fe4fa7478 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:12.860354 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58688) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:12.863051 dv-cinder-773870-6-iscsi neutron-server[110214]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jun 17 10:59:12.888069 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.8944447 Jun 17 10:59:13.027253 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.db_base_plugin_common [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Allocated IP 172.20.0.2 (54973ccd-0b2b-4517-ad28-76a3128a2da3/b70c69a2-cf24-49e5-90dd-a210bd42e6bb/9a80deac-57f8-4a0e-a926-2352dfa6b72b) {{(pid=110216) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 10:59:13.110428 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-7aacb301-a977-4544-9b72-7f93a419c239 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:13.118998 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-7aacb301-a977-4544-9b72-7f93a419c239 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 814 time: 0.2570858 Jun 17 10:59:13.136710 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-0882d803-7478-470b-a213-b3d388563411 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/quotas/5a3d5a50b1194ca594e398fd941cbe5f HTTP/1.1" status: 200 len: 375 time: 0.0161796 Jun 17 10:59:13.157540 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8287140', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8358552', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2037'] for router, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:13.162473 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15a95922-c291-4788-afca-64e6e6e496cf None None] Network e30545f7-6269-420b-a870-c56fe4fa7478 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:13.188927 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e4bb95af-0c6e-409f-9c31-b49db628679c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0518296 Jun 17 10:59:13.331143 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-c85f065d-84f5-40d6-9ded-493b68cb018b service neutron] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110214) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 10:59:13.332131 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-c85f065d-84f5-40d6-9ded-493b68cb018b service neutron] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0487096 Jun 17 10:59:13.423372 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Notify callbacks [] for port, precommit_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:13.433204 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Transition to ACTIVE for port object 9a80deac-57f8-4a0e-a926-2352dfa6b72b will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:59:13.469786 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Transition to ACTIVE for port object 9a80deac-57f8-4a0e-a926-2352dfa6b72b will not be triggered until provisioned by entity DHCP. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:59:13.473487 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-8e0d89fb-c1a6-4df5-89c7-4427632e2a30 service neutron] 10.222.0.41 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1332326 Jun 17 10:59:13.559028 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:13.563259 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:13.585998 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-00e8cca5-0a97-440e-9439-1049abc54370 service neutron] 10.222.0.41 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1059427 Jun 17 10:59:13.632706 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Network 54973ccd-0b2b-4517-ad28-76a3128a2da3 is already hosted by enough agents. {{(pid=110216) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:59:13.637658 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.base_scheduler [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Resources bound (agent type, host, resource id): {{(pid=110216) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:13.639400 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Pushing event updated for resources: {'Port': ['ID=9a80deac-57f8-4a0e-a926-2352dfa6b72b,revision_number=1']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:13.642553 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Received port after_create {{(pid=110216) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 10:59:13.652024 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.652385 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.652723 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.654839 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.654839 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.654839 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.654839 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.654839 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.654839 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.655396 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.655396 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.655559 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Tracked resource versions report: Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: pushed versions: Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: { 'AddressGroup': {'1.2'}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'ConntrackHelper': {'1.0'}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Log': {'1.0'}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Network': {'1.1'}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Port': {'1.7'}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'PortForwarding': {'1.2'}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'QosPolicy': {'1.8'}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SecurityGroup': {'1.4'}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SecurityGroupRule': {'1.2'}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SubPort': {'1.0'}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Subnet': {'1.1'}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Trunk': {'1.1'}} Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: consumer versions: Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: { DHCP agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: HyperV agent@hv-cinder-77387: {}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: L3 agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: Metadata agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: Metering agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: Open vSwitch agent@dv-cinder-773870-6-iscsi: { 'AddressGroup': '1.2', Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'ConntrackHelper': '1.0', Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Log': '1.0', Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Network': '1.1', Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Port': '1.7', Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'PortForwarding': '1.2', Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'QosPolicy': '1.8', Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SecurityGroup': '1.4', Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SecurityGroupRule': '1.2', Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'SubPort': '1.0', Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Subnet': '1.1', Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: 'Trunk': '1.1'}} Jun 17 10:59:13.656715 dv-cinder-773870-6-iscsi neutron-server[110216]: {{(pid=110216) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jun 17 10:59:13.663345 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:13.691289 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:13.727504 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:13.735256 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Attempting to bind port 9a80deac-57f8-4a0e-a926-2352dfa6b72b on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 10:59:13.736562 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Attempting to bind port 9a80deac-57f8-4a0e-a926-2352dfa6b72b by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 10:59:13.737420 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Attempting to bind port 9a80deac-57f8-4a0e-a926-2352dfa6b72b on network 54973ccd-0b2b-4517-ad28-76a3128a2da3 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:59:13.744971 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 10, 58, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 10:59:13.745765 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Checking segment: {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:13.746361 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:13.747397 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Bound using segment: {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 10:59:13.747926 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Bound port: 9a80deac-57f8-4a0e-a926-2352dfa6b72b, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 10:59:13.748314 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:13.786098 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58722) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:13.863324 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] For port 9a80deac-57f8-4a0e-a926-2352dfa6b72b, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 10:59:13.875236 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] For port 9a80deac-57f8-4a0e-a926-2352dfa6b72b, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=9a80deac-57f8-4a0e-a926-2352dfa6b72b,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 10:59:13.924861 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Allocated IP 172.27.3.241 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/6e11f01c-6a5e-4843-8522-d954d8b50545) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 10:59:13.936823 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6c7e4eb8-3d21-47d0-a72e-43d704eb58d3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:13.959522 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:13.988621 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:14.143901 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6c7e4eb8-3d21-47d0-a72e-43d704eb58d3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:14.160133 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Pushing event updated for resources: {'Port': ['ID=9a80deac-57f8-4a0e-a926-2352dfa6b72b,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:14.164254 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:14.187437 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:14.405322 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:14.408258 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:14.425591 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6c7e4eb8-3d21-47d0-a72e-43d704eb58d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:14.453047 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-279da924-4e64-4ad2-9c42-8d9f086b8148 req-0cec3e40-5035-46fd-98e2-2746af270dc5 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.2316842 Jun 17 10:59:14.467214 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:14.503329 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c7e4eb8-3d21-47d0-a72e-43d704eb58d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76863030-a820-4aef-b029-8656df368add,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:14.508883 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:59:14.518064 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58776) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:14.519693 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:14.522887 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6c7e4eb8-3d21-47d0-a72e-43d704eb58d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:14.527903 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 10:59:14.534254 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-6c7e4eb8-3d21-47d0-a72e-43d704eb58d3 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=8e89afb127df4f9d9938ecf1f667275e&name=default HTTP/1.1" status: 200 len: 2975 time: 0.7470229 Jun 17 10:59:14.535183 dv-cinder-773870-6-iscsi neutron-server[110215]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jun 17 10:59:14.536770 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58780) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:14.603065 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6412ceb1-6b9f-41ec-a703-2ce2ec14565e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:14.631255 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6412ceb1-6b9f-41ec-a703-2ce2ec14565e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:14.804140 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6412ceb1-6b9f-41ec-a703-2ce2ec14565e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:14.807150 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6412ceb1-6b9f-41ec-a703-2ce2ec14565e admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:14.813821 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-6412ceb1-6b9f-41ec-a703-2ce2ec14565e admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/76863030-a820-4aef-b029-8656df368add HTTP/1.1" status: 204 len: 168 time: 0.2751307 Jun 17 10:59:14.815050 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:14.824977 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6412ceb1-6b9f-41ec-a703-2ce2ec14565e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76863030-a820-4aef-b029-8656df368add,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:14.827443 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6412ceb1-6b9f-41ec-a703-2ce2ec14565e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:14.837215 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Pushing event updated for resources: {'Port': ['ID=6e11f01c-6a5e-4843-8522-d954d8b50545,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:14.864106 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.456s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:14.925721 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16568e87-47a4-42ed-932e-71013903a7ce req-3970da0b-700c-46c3-912c-b65e7d8f7954 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:14.927428 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-3970da0b-700c-46c3-912c-b65e7d8f7954 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/networks?id=e30545f7-6269-420b-a870-c56fe4fa7478 HTTP/1.1" status: 200 len: 812 time: 0.4011016 Jun 17 10:59:14.944335 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-4b6e02ea-1578-4768-a836-a78109203cec tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/quotas/95dd44ce5be843a295db7140aba1fb25 HTTP/1.1" status: 200 len: 375 time: 0.0106936 Jun 17 10:59:15.010228 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-efae38a9-c3f8-434d-9b3a-c8208431fd4c tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=95dd44ce5be843a295db7140aba1fb25&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0596058 Jun 17 10:59:15.197617 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:15.312439 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-134c640e-cc1e-46c9-947b-8c7b57824dce service neutron] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110215) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 10:59:15.314424 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-134c640e-cc1e-46c9-947b-8c7b57824dce service neutron] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1245425 Jun 17 10:59:15.496051 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0aa5a78b-d285-473c-aa3d-10b50a06352b None None] Network 54973ccd-0b2b-4517-ad28-76a3128a2da3 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:15.625725 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-8b90c00a-1873-4d05-8082-8a63c8178068 service neutron] 10.222.0.41 "GET /v2.0/networks/e30545f7-6269-420b-a870-c56fe4fa7478?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3013887 Jun 17 10:59:15.633373 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-c193f443-d170-4755-ae53-755e8d8ec2d4 None None] Provisioning for port 9a80deac-57f8-4a0e-a926-2352dfa6b72b completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:59:15.662002 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8358543', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8287186'] for router, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:15.797740 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58848) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:15.805103 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-803ca511-a7ea-441d-83f4-4a3015fea7cf service neutron] 10.222.0.41 "GET /v2.0/networks/e30545f7-6269-420b-a870-c56fe4fa7478?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1708560 Jun 17 10:59:15.854317 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58850) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:15.855465 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1624d2fa-ae1c-4f9f-92ef-3a5a2874cd25 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.009869 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Router a17f3ab0-fe2c-4834-806d-28b3794b6366 is scheduled to L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 with binding_index 1 {{(pid=110215) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} Jun 17 10:59:16.011951 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 9a80deac-57f8-4a0e-a926-2352dfa6b72b up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:59:16.090571 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1624d2fa-ae1c-4f9f-92ef-3a5a2874cd25 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.140676 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b32651bb-488e-4547-b930-56c3d3306dfb req-898a675b-9a32-45db-92e9-368c9ddeb8a0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.0758922 Jun 17 10:59:16.168020 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ef3d647a-09c5-45b9-991f-8dbb6d413949 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.215205 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1624d2fa-ae1c-4f9f-92ef-3a5a2874cd25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.216288 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 9a80deac-57f8-4a0e-a926-2352dfa6b72b completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:59:16.225339 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:16.225439 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 9a80deac-57f8-4a0e-a926-2352dfa6b72b triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:16.225439 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.290232 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 10:59:16.300895 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Sync routers for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 10:59:16.314595 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 10:59:16.320738 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T10:58:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:16.359803 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.366219 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1624d2fa-ae1c-4f9f-92ef-3a5a2874cd25 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d9e1219-31b5-4b00-a4c8-0934dda83d2e,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:16.415440 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-1624d2fa-ae1c-4f9f-92ef-3a5a2874cd25 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=3c34c0218bbc46f88754eb28c846e63e&name=default HTTP/1.1" status: 200 len: 2975 time: 0.6123891 Jun 17 10:59:16.415440 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58886) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:16.415741 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-1624d2fa-ae1c-4f9f-92ef-3a5a2874cd25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:16.439891 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-52445377-80ac-4f2b-8493-064da15026d4 req-56d0f5e4-2dc4-4e68-a4b2-88737e7ad731 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 210 time: 0.1023149 Jun 17 10:59:16.494901 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 9a80deac-57f8-4a0e-a926-2352dfa6b72b, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=9a80deac-57f8-4a0e-a926-2352dfa6b72b,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:16.528279 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-44fa0f24-71e1-44af-b42f-29f8f97b9c0d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.559166 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-44fa0f24-71e1-44af-b42f-29f8f97b9c0d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.596196 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.598390 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-1e349928-b987-48c6-8bb0-3c3fcf749ad7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:16.621783 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ef3d647a-09c5-45b9-991f-8dbb6d413949 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.651347 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 10:59:16.666008 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=9a80deac-57f8-4a0e-a926-2352dfa6b72b,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:16.673850 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:16.752763 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58908) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:16.753372 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ef3d647a-09c5-45b9-991f-8dbb6d413949 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.756389 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:16.809968 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-44fa0f24-71e1-44af-b42f-29f8f97b9c0d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.813329 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-44fa0f24-71e1-44af-b42f-29f8f97b9c0d admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.814992 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-44fa0f24-71e1-44af-b42f-29f8f97b9c0d admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/3d9e1219-31b5-4b00-a4c8-0934dda83d2e HTTP/1.1" status: 204 len: 168 time: 0.3972845 Jun 17 10:59:16.820768 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6412ceb1-6b9f-41ec-a703-2ce2ec14565e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:16.821999 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-ef3d647a-09c5-45b9-991f-8dbb6d413949 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=e1910d0cd75e43478eb509493b0afbfb&name=default HTTP/1.1" status: 200 len: 2975 time: 0.9666371 Jun 17 10:59:16.827140 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58918) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:16.831927 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef3d647a-09c5-45b9-991f-8dbb6d413949 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=039811f3-590e-49f5-adf8-d1a4fd721988,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:16.833745 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44fa0f24-71e1-44af-b42f-29f8f97b9c0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d9e1219-31b5-4b00-a4c8-0934dda83d2e,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:16.835764 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ef3d647a-09c5-45b9-991f-8dbb6d413949 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:16.838580 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-44fa0f24-71e1-44af-b42f-29f8f97b9c0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:16.843852 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Notify callbacks [] for router, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.855033 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] 10.222.0.41 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 4.3777812 Jun 17 10:59:16.857365 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 58920) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:16.910392 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ff56c11c-73bf-4900-8279-37f43c28e16e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.914363 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:14Z', 'revision_number': 3, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:16.919894 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5d0a50be-92a3-487c-979f-b41a2af81a86 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.947529 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Checking router: a17f3ab0-fe2c-4834-806d-28b3794b6366 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 10:59:16.947862 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Updating router a17f3ab0-fe2c-4834-806d-28b3794b6366 port 6e11f01c-6a5e-4843-8522-d954d8b50545 binding host dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 10:59:16.953808 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ff56c11c-73bf-4900-8279-37f43c28e16e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:16.984335 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.066379 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5d0a50be-92a3-487c-979f-b41a2af81a86 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.089150 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ff56c11c-73bf-4900-8279-37f43c28e16e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.092031 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ff56c11c-73bf-4900-8279-37f43c28e16e admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.095969 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-ff56c11c-73bf-4900-8279-37f43c28e16e admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/039811f3-590e-49f5-adf8-d1a4fd721988 HTTP/1.1" status: 204 len: 168 time: 0.2649236 Jun 17 10:59:17.095969 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:17.108892 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff56c11c-73bf-4900-8279-37f43c28e16e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=039811f3-590e-49f5-adf8-d1a4fd721988,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:17.130256 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-ff56c11c-73bf-4900-8279-37f43c28e16e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:17.135522 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5d0a50be-92a3-487c-979f-b41a2af81a86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.169821 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6c7e4eb8-3d21-47d0-a72e-43d704eb58d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:17.243403 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d0a50be-92a3-487c-979f-b41a2af81a86 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=208f8b46-aba6-4a2f-985f-bedfa49f6585,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:17.254504 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-5d0a50be-92a3-487c-979f-b41a2af81a86 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=10df42513a7c42a7b8acecc39254c963&name=default HTTP/1.1" status: 200 len: 2975 time: 0.5052617 Jun 17 10:59:17.255637 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5d0a50be-92a3-487c-979f-b41a2af81a86 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:17.259319 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 58930) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:17.364304 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Notify callbacks [] for port, precommit_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.388446 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.provisioning_blocks [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Transition to ACTIVE for port object 6e11f01c-6a5e-4843-8522-d954d8b50545 will not be triggered until provisioned by entity L2. {{(pid=110218) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:59:17.391843 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8d51c329-5082-4174-90b2-af33a87e706e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.419442 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8d51c329-5082-4174-90b2-af33a87e706e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.455551 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.460483 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-b1158162-61c4-4470-8c66-028b75980a0b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:17.487088 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6a8898b0-b692-4c11-837f-5e445a9f420c req-a49cdc5c-825e-4e09-8365-9f49e0b3f14d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.0513003 Jun 17 10:59:17.505603 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.600711 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-07da5cfe-37b2-4f0e-b426-88da00be6899 req-e891595f-d3a7-4bf0-93e1-bc763a914ed4 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 210 time: 0.0772035 Jun 17 10:59:17.601613 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8d51c329-5082-4174-90b2-af33a87e706e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.604556 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8d51c329-5082-4174-90b2-af33a87e706e admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.619954 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-8d51c329-5082-4174-90b2-af33a87e706e admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/208f8b46-aba6-4a2f-985f-bedfa49f6585 HTTP/1.1" status: 204 len: 168 time: 0.3584228 Jun 17 10:59:17.621886 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-44fa0f24-71e1-44af-b42f-29f8f97b9c0d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:17.643922 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d51c329-5082-4174-90b2-af33a87e706e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=208f8b46-aba6-4a2f-985f-bedfa49f6585,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:17.646351 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-8d51c329-5082-4174-90b2-af33a87e706e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:17.649443 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Attempting to bind port 6e11f01c-6a5e-4843-8522-d954d8b50545 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 10:59:17.649987 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Attempting to bind port 6e11f01c-6a5e-4843-8522-d954d8b50545 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 10:59:17.650485 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Attempting to bind port 6e11f01c-6a5e-4843-8522-d954d8b50545 on network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:59:17.657844 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Pushing event updated for resources: {'Port': ['ID=6e11f01c-6a5e-4843-8522-d954d8b50545,revision_number=2']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:17.662523 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 10, 58, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 10:59:17.663297 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Checking segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110218) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:17.664022 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.664613 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Bound using segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 10:59:17.665292 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Bound port: 6e11f01c-6a5e-4843-8522-d954d8b50545, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 10:59:17.665857 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.736327 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.737092 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.737635 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.738172 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.738719 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.739291 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.739834 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.740370 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.740910 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.741431 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.742722 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.743313 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Tracked resource versions report: Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: pushed versions: Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: { 'AddressGroup': {'1.2'}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'ConntrackHelper': {'1.0'}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Log': {'1.0'}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Network': {'1.1'}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Port': {'1.7'}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'PortForwarding': {'1.2'}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'QosPolicy': {'1.8'}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SecurityGroup': {'1.4'}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SecurityGroupRule': {'1.2'}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SubPort': {'1.0'}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Subnet': {'1.1'}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Trunk': {'1.1'}} Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: consumer versions: Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: { DHCP agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: HyperV agent@hv-cinder-77387: {}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: L3 agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: Metadata agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: Metering agent@dv-cinder-773870-6-iscsi: {}, Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: Open vSwitch agent@dv-cinder-773870-6-iscsi: { 'AddressGroup': '1.2', Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'ConntrackHelper': '1.0', Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Log': '1.0', Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Network': '1.1', Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Port': '1.7', Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'PortForwarding': '1.2', Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'QosPolicy': '1.8', Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SecurityGroup': '1.4', Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SecurityGroupRule': '1.2', Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'SubPort': '1.0', Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Subnet': '1.1', Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: 'Trunk': '1.1'}} Jun 17 10:59:17.744596 dv-cinder-773870-6-iscsi neutron-server[110218]: {{(pid=110218) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Jun 17 10:59:17.765792 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.305s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:17.768432 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] For port 6e11f01c-6a5e-4843-8522-d954d8b50545, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110218) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 10:59:17.771946 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] For port 6e11f01c-6a5e-4843-8522-d954d8b50545, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=6e11f01c-6a5e-4843-8522-d954d8b50545,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110218) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 10:59:17.868260 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:17.871867 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:17.872972 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Allocated IP 172.20.0.1 (54973ccd-0b2b-4517-ad28-76a3128a2da3/b70c69a2-cf24-49e5-90dd-a210bd42e6bb/a33b3689-e1bb-4011-a6d6-f16dff180486) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 10:59:17.893789 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 9a80deac-57f8-4a0e-a926-2352dfa6b72b up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:59:17.924193 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 10:59:17.924836 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T10:58:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:18.004007 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:18.005077 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 9a80deac-57f8-4a0e-a926-2352dfa6b72b triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:18.005456 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:18.021117 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Pushing event updated for resources: {'Port': ['ID=6e11f01c-6a5e-4843-8522-d954d8b50545,revision_number=3']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:18.026119 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Transition to ACTIVE for port object a33b3689-e1bb-4011-a6d6-f16dff180486 will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:59:18.030471 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:18.072955 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 10:59:18.147686 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:18.151616 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-96e2dc2b-ebed-4991-84b3-ce4cfe0cd5cb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:18.214521 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Network 54973ccd-0b2b-4517-ad28-76a3128a2da3 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:59:18.229459 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:18.235703 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 10:59:18.235703 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8290659'] for router_interface, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:18.366100 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:14Z', 'revision_number': 3, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:18.467611 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4784cbd2-01fe-47be-9f25-1d530a0a4394 None None] The sync data for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi is: [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:14Z', 'revision_number': 3, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 10:59:18.475147 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Pushing event updated for resources: {'Port': ['ID=a33b3689-e1bb-4011-a6d6-f16dff180486,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:18.486490 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:18.638274 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-5d212aef-b47f-49fd-a4e5-b51f7b12459a None None] Provisioning for port a33b3689-e1bb-4011-a6d6-f16dff180486 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:59:18.645100 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-5d212aef-b47f-49fd-a4e5-b51f7b12459a None None] Provisioning complete for port a33b3689-e1bb-4011-a6d6-f16dff180486 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:18.652605 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-5d212aef-b47f-49fd-a4e5-b51f7b12459a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:18.690251 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-19ddbecb-9616-41c4-a2b3-5814f6756556 req-66ac3fe3-2f9d-4705-99ba-0803e85a0626 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.0441456 Jun 17 10:59:18.706647 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-5d212aef-b47f-49fd-a4e5-b51f7b12459a None None] Port a33b3689-e1bb-4011-a6d6-f16dff180486 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 10:59:18.873860 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2a2b2f20-d07c-43b6-b47d-cece0ea4aa7d req-cada37eb-8250-40c1-924d-00456f1aaa1c tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 210 time: 0.0522296 Jun 17 10:59:18.913744 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:19.127969 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:19.219459 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:19.223803 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7899558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8290591'] for router_interface, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:19.223803 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:19.282228 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Pushing event updated for resources: {'Port': ['ID=a33b3689-e1bb-4011-a6d6-f16dff180486,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:19.286014 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:19.356661 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Network 54973ccd-0b2b-4517-ad28-76a3128a2da3 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:59:19.358741 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:19.464012 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59022) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:19.497910 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Router a17f3ab0-fe2c-4834-806d-28b3794b6366 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 10:59:19.615815 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 10:59:19.622501 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] 10.222.0.41 "PUT /v2.0/routers/a17f3ab0-fe2c-4834-806d-28b3794b6366/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7641265 Jun 17 10:59:19.643459 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-19afded9-436e-4d38-ae70-58eb8b2e2b24 None None] Provisioning complete for port a33b3689-e1bb-4011-a6d6-f16dff180486 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:19.644714 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-19afded9-436e-4d38-ae70-58eb8b2e2b24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:19.681134 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-19afded9-436e-4d38-ae70-58eb8b2e2b24 None None] Port a33b3689-e1bb-4011-a6d6-f16dff180486 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 10:59:19.826499 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2109402658-network', 'tenant_id': '5bad3fa49531495d8f0a3178ce25d4d5'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:19.860224 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c3f3c9e7-e376-4802-aa88-d300e18a98df req-be98a0c8-b580-45bc-b947-343fa87daf1f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.0483561 Jun 17 10:59:19.952123 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Made reservation on behalf of 5bad3fa49531495d8f0a3178ce25d4d5 for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:19.956592 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:19.974329 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 6e11f01c-6a5e-4843-8522-d954d8b50545 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:59:19.988048 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.078577 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b999495c-fe4a-498d-9ba8-9cf54eb58df7 req-b67752af-38b1-4b84-bea2-d34416bae9c6 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 210 time: 0.0606496 Jun 17 10:59:20.118677 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 6e11f01c-6a5e-4843-8522-d954d8b50545 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:59:20.123790 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 6e11f01c-6a5e-4843-8522-d954d8b50545 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:20.124164 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.178787 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.238467 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.244964 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.249392 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:20.286885 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] vlan segment allocate from pool success with {'vlan_id': 131, 'physical_network': 'physnet1'} {{(pid=110215) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 10:59:20.289708 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 6e11f01c-6a5e-4843-8522-d954d8b50545, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=6e11f01c-6a5e-4843-8522-d954d8b50545,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:20.310662 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=13abde0f-a229-4e17-b594-f532c0ebf32c,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:20.336632 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:20.340070 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.340412 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Added segment 52ec7769-4f5e-44f8-b467-c0285cb06fd1 of type vlan for network c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab Jun 17 10:59:20.346488 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.349102 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:20.391286 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.402276 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=6e11f01c-6a5e-4843-8522-d954d8b50545,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:20.405378 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:20.428090 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Sync routers for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 10:59:20.437273 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 10:59:20.437901 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T10:58:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:20.495589 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.497004 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:20.497668 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.501111 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c3faaeab-6430-46d4-be47-3d68e07b9eaa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:20.570801 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Pushing event updated for resources: {'Network': ['ID=c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:20.573879 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:20.586240 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 10:59:20.593293 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.1273489 Jun 17 10:59:20.596166 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59066) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:20.604250 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Request body: {'subnet': {'network_id': 'c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2109402658-subnet', 'tenant_id': '5bad3fa49531495d8f0a3178ce25d4d5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:20.617640 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 10:59:20.689986 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d81401ad-bc6a-4760-a2bf-bb84ce4bce54 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.694426 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Made reservation on behalf of 5bad3fa49531495d8f0a3178ce25d4d5 for: {'subnet': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:20.697408 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Notify callbacks [] for subnet, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.778863 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59076) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:20.787896 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-f43ac758-0a0d-42ae-9816-5dc338bc2b54 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1377006573', 'description': 'tempest-description--954206250'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:20.904594 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 2, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:20.920315 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f43ac758-0a0d-42ae-9816-5dc338bc2b54 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.939203 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Checking router: a17f3ab0-fe2c-4834-806d-28b3794b6366 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 10:59:20.939686 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Updating router a17f3ab0-fe2c-4834-806d-28b3794b6366 port a33b3689-e1bb-4011-a6d6-f16dff180486 binding host dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 10:59:20.991170 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:20.997443 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485'] for subnet, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.001976 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-57d30056-95bc-41da-8178-d28d53de7199 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:21.063039 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f43ac758-0a0d-42ae-9816-5dc338bc2b54 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.096677 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e6cc76f5-85d0-4b63-bb04-5617e9bf547b req-489de143-4fcb-4f4f-92a1-3fa192b7d7a3 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.0281177 Jun 17 10:59:21.131598 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Checking segment: {'id': '52ec7769-4f5e-44f8-b467-c0285cb06fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': 'c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110214) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:21.132191 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Network hostable DHCP agents. Network: c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110214) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 10:59:21.135531 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f43ac758-0a0d-42ae-9816-5dc338bc2b54 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.144948 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:21.155386 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a774e886-2986-4097-8f2c-20011a4f6feb,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:21.169962 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:21.198079 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f43ac758-0a0d-42ae-9816-5dc338bc2b54 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b02c5682-d2cc-40d2-81a5-81d43f06e80d,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:21.214035 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f43ac758-0a0d-42ae-9816-5dc338bc2b54 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:21.233303 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Network c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110214) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 10:59:21.236579 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f43ac758-0a0d-42ae-9816-5dc338bc2b54 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.248635 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59098) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:21.248867 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f43ac758-0a0d-42ae-9816-5dc338bc2b54 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1777 time: 0.4619026 Jun 17 10:59:21.249000 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-7150fcf1-a0ca-4f2d-9b81-6205a3fe9f30 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'security_group_rule': {'security_group_id': 'b02c5682-d2cc-40d2-81a5-81d43f06e80d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:21.318840 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5665f3cc-be59-48e6-86fe-dbf737f7073f req-9cc87d07-ebf2-44e1-8bf3-279dd3d97ba2 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 210 time: 0.0282481 Jun 17 10:59:21.360895 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab) {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:21.369565 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:21.370229 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.372555 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7150fcf1-a0ca-4f2d-9b81-6205a3fe9f30 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.372725 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49e2e2d8-6213-40f9-a0d9-ea1339ed7419 None None] Network c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:21.489585 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7150fcf1-a0ca-4f2d-9b81-6205a3fe9f30 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.493397 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.8949623 Jun 17 10:59:21.515584 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Notify callbacks [] for port, precommit_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.536446 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Transition to ACTIVE for port object a33b3689-e1bb-4011-a6d6-f16dff180486 will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:59:21.586815 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7150fcf1-a0ca-4f2d-9b81-6205a3fe9f30 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.589061 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:21.599962 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-009678a6-3a84-4675-b01a-9e69333439d6 None None] Network c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:21.612671 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7150fcf1-a0ca-4f2d-9b81-6205a3fe9f30 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=db6dbd2f-a3aa-4911-8d87-7efd741a191c,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:21.627356 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-7150fcf1-a0ca-4f2d-9b81-6205a3fe9f30 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:21.632870 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.652860 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-860a9c24-6dfe-4f30-a549-f9005161ab0a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:21.712774 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7150fcf1-a0ca-4f2d-9b81-6205a3fe9f30 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.714066 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-7150fcf1-a0ca-4f2d-9b81-6205a3fe9f30 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4708745 Jun 17 10:59:21.716875 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59110) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:21.722369 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-f40bdb72-4bfc-40c4-bad1-29e2b40ed1f7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'security_group_rule': {'security_group_id': 'b02c5682-d2cc-40d2-81a5-81d43f06e80d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:21.860869 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8b3ecc6-0ef7-4217-b4f2-6cde410fcfa9 None None] Pushing event updated for resources: {'Port': ['ID=a33b3689-e1bb-4011-a6d6-f16dff180486,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:21.869512 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f40bdb72-4bfc-40c4-bad1-29e2b40ed1f7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.895229 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-b8b3ecc6-0ef7-4217-b4f2-6cde410fcfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:21.923116 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Attempting to bind port a33b3689-e1bb-4011-a6d6-f16dff180486 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 10:59:21.923500 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Attempting to bind port a33b3689-e1bb-4011-a6d6-f16dff180486 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 10:59:21.923869 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Attempting to bind port a33b3689-e1bb-4011-a6d6-f16dff180486 on network 54973ccd-0b2b-4517-ad28-76a3128a2da3 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:59:21.946250 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 10, 58, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 10:59:21.946880 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Checking segment: {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:21.947438 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.947982 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Bound using segment: {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 10:59:21.948763 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Bound port: a33b3689-e1bb-4011-a6d6-f16dff180486, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 10:59:21.949315 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:21.956814 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 6e11f01c-6a5e-4843-8522-d954d8b50545 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:59:22.038503 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f40bdb72-4bfc-40c4-bad1-29e2b40ed1f7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:22.066652 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 6e11f01c-6a5e-4843-8522-d954d8b50545 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:22.066652 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:22.120336 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f40bdb72-4bfc-40c4-bad1-29e2b40ed1f7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:22.133117 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:22.163976 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f40bdb72-4bfc-40c4-bad1-29e2b40ed1f7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=feec8aac-9358-4a8e-b7b4-5217df85c8e0,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:22.167700 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f40bdb72-4bfc-40c4-bad1-29e2b40ed1f7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:22.260982 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f40bdb72-4bfc-40c4-bad1-29e2b40ed1f7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:22.262542 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f40bdb72-4bfc-40c4-bad1-29e2b40ed1f7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5441239 Jun 17 10:59:22.265170 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59146) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:22.274045 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'floatingip': {'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:22.298228 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] For port a33b3689-e1bb-4011-a6d6-f16dff180486, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 10:59:22.298228 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] For port a33b3689-e1bb-4011-a6d6-f16dff180486, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=a33b3689-e1bb-4011-a6d6-f16dff180486,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 10:59:22.371454 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-46995a90-32db-4848-9f00-58e2979dba6d req-dc21baa3-3f24-478a-8360-c2446ca01152 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.0446289 Jun 17 10:59:22.391765 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:22.395261 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:22.436019 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:22.459826 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 10:59:22.461289 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T10:58:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:22.519394 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f5c387f5-c1db-473d-99a7-745898cac889 req-136f9a8f-984c-49f4-ae4a-de10a6e9188a tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 210 time: 0.0539122 Jun 17 10:59:22.590329 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59158) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:22.596676 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1874564552-network', 'tenant_id': '36ea45849e644418a884a10a0dd31410'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:22.601568 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8b3ecc6-0ef7-4217-b4f2-6cde410fcfa9 None None] Pushing event updated for resources: {'Port': ['ID=a33b3689-e1bb-4011-a6d6-f16dff180486,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:22.602929 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-b8b3ecc6-0ef7-4217-b4f2-6cde410fcfa9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:22.709207 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 10:59:22.713347 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Made reservation on behalf of 36ea45849e644418a884a10a0dd31410 for: {'network': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:22.716482 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:22.727844 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:22.781314 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:22.818107 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59162) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:23.009415 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.25', 49863) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:23.018080 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.021480 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:22Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:23.083422 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-15f1c3a9-f508-4e5a-bd5b-e69d75f735e5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.085041 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4a3283e-48ab-41f2-8a1c-8be4a7def57d None None] The sync data for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi is: [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:22Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 10:59:23.085950 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.085950 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=110214) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 10:59:23.128809 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.129146 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.segments_db [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Added segment a5391947-cede-4558-bd2b-b8cf4eb4ebb6 of type vlan for network c023b3d2-1cce-4601-83dd-4d081666866f Jun 17 10:59:23.140302 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:23.190480 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2430b9d-8f6e-4222-909c-9907f3311207,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:23.198268 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Allocated IP 172.27.3.86 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/72b90c9a-f7fd-4fb7-b295-89a14b662c32) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 10:59:23.207021 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:23.238800 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16568e87-47a4-42ed-932e-71013903a7ce req-91562037-1a62-4abf-af9c-5fd8649fc55d tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:23.241649 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-91562037-1a62-4abf-af9c-5fd8649fc55d tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.25 "GET /v2.0/networks?id=e30545f7-6269-420b-a870-c56fe4fa7478 HTTP/1.1" status: 200 len: 812 time: 0.3727024 Jun 17 10:59:23.264193 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.338219 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Request body: {'port': {'device_id': 'cf72262e-dfa5-4b03-b340-7b31fd5ecec6', 'network_id': 'e30545f7-6269-420b-a870-c56fe4fa7478', 'admin_state_up': True, 'tenant_id': '95dd44ce5be843a295db7140aba1fb25'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:23.357847 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-67978d3a-ef53-4aa9-b2ba-87600e7db94e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.387042 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-15f1c3a9-f508-4e5a-bd5b-e69d75f735e5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.398191 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.401108 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:23.401940 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.415499 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:23.456093 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-15f1c3a9-f508-4e5a-bd5b-e69d75f735e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.527633 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-15f1c3a9-f508-4e5a-bd5b-e69d75f735e5 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=e9a0efb6ea2c45cdb478cbc637c2c0a5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7072182 Jun 17 10:59:23.528401 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.528822 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.9372389 Jun 17 10:59:23.546139 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59186) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:23.546488 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59188) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:23.584624 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Pushing event updated for resources: {'Network': ['ID=c023b3d2-1cce-4601-83dd-4d081666866f,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:23.595998 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:23.597310 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5d0a50be-92a3-487c-979f-b41a2af81a86 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.083s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:23.598686 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network c023b3d2-1cce-4601-83dd-4d081666866f details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 10:59:23.613929 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Request body: {'subnet': {'network_id': 'c023b3d2-1cce-4601-83dd-4d081666866f', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1874564552-subnet', 'tenant_id': '36ea45849e644418a884a10a0dd31410', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:23.644458 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.679144 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15f1c3a9-f508-4e5a-bd5b-e69d75f735e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b0536de7-9050-462b-b43c-2129e6a7fca7,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:23.683420 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e49f2447-1cda-45e7-b119-83b314d81a51 req-2e9d1449-4ea1-427d-8b30-9cae925d327e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.0541315 Jun 17 10:59:23.684407 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-15f1c3a9-f508-4e5a-bd5b-e69d75f735e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:23.711145 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3fe79b32-831a-43e0-8ff7-cfb60675aa47 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.735984 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3fe79b32-831a-43e0-8ff7-cfb60675aa47 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.810554 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Made reservation on behalf of 95dd44ce5be843a295db7140aba1fb25 for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:23.814267 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:23.883086 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4baea0a8-eb10-4c27-95f6-257686ea9f06 req-6b81a69a-312e-4dd1-9c74-35b1ac927f42 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 210 time: 0.0540087 Jun 17 10:59:23.980163 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device a33b3689-e1bb-4011-a6d6-f16dff180486 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:59:23.989535 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Made reservation on behalf of 36ea45849e644418a884a10a0dd31410 for: {'subnet': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:23.992057 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Notify callbacks [] for subnet, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.058633 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.093504 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:24.193586 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port a33b3689-e1bb-4011-a6d6-f16dff180486 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:59:24.201424 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port a33b3689-e1bb-4011-a6d6-f16dff180486 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:24.201424 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.208001 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3fe79b32-831a-43e0-8ff7-cfb60675aa47 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.236057 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3fe79b32-831a-43e0-8ff7-cfb60675aa47 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.240181 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-3fe79b32-831a-43e0-8ff7-cfb60675aa47 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/b0536de7-9050-462b-b43c-2129e6a7fca7 HTTP/1.1" status: 204 len: 168 time: 0.6886494 Jun 17 10:59:24.252452 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:59:24.305561 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Allocated IP 172.20.0.3 (e30545f7-6269-420b-a870-c56fe4fa7478/556ccdca-d712-410a-a954-c43564443811/879bb19b-66f7-48e8-83ce-097684433ad0) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 10:59:24.319762 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'Port': ['ID=72b90c9a-f7fd-4fb7-b295-89a14b662c32,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:24.328084 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:24.329031 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:24.339693 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.101s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:24.344747 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 10:59:24.361343 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.376044 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fe79b32-831a-43e0-8ff7-cfb60675aa47 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b0536de7-9050-462b-b43c-2129e6a7fca7,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:24.426318 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port a33b3689-e1bb-4011-a6d6-f16dff180486, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=a33b3689-e1bb-4011-a6d6-f16dff180486,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:24.437307 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.442624 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3fe79b32-831a-43e0-8ff7-cfb60675aa47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:24.495515 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.501351 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:24.558805 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=a33b3689-e1bb-4011-a6d6-f16dff180486,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:24.561977 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:24.579934 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.749637 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.776693 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.783341 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485'] for subnet, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:24.792460 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:24.851317 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e960d7d6-e349-494f-a9c5-5cd613ef3ce5 req-63f08b5a-c152-4919-9299-2153a67683ed tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.0269876 Jun 17 10:59:24.930307 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1c33d4d9-7bdf-4100-a73f-7ef1758ff938,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:24.941365 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:24.949883 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Checking segment: {'id': 'a5391947-cede-4558-bd2b-b8cf4eb4ebb6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'c023b3d2-1cce-4601-83dd-4d081666866f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:24.950230 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Network hostable DHCP agents. Network: c023b3d2-1cce-4601-83dd-4d081666866f, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110215) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 10:59:24.986661 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59220) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:25.004354 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-35e2256b-b4a5-4df4-ad9b-7e4533ee1aab admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.006008 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.036964 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6a34e726-1d85-48e5-9510-bcb2d2b75645 req-4a6165f4-1f5b-4055-a46c-a6e6847a0e3d tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 210 time: 0.0343392 Jun 17 10:59:25.038379 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.046975 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5732ae28-f4ba-4f4e-b20f-dd851c97608a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:25.098262 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Network c023b3d2-1cce-4601-83dd-4d081666866f is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110215) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 10:59:25.105684 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-35e2256b-b4a5-4df4-ad9b-7e4533ee1aab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.134748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Network e30545f7-6269-420b-a870-c56fe4fa7478 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:59:25.135526 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.144510 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:25.154823 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 10:59:25.160777 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:25.161634 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.176782 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Pushing event updated for resources: {'Port': ['ID=879bb19b-66f7-48e8-83ce-097684433ad0,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:25.189731 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-35e2256b-b4a5-4df4-ad9b-7e4533ee1aab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.191046 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:25.192452 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.038s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:25.192889 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:25.218542 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, c023b3d2-1cce-4601-83dd-4d081666866f) {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:25.226159 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:25.226742 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.230430 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-35e2256b-b4a5-4df4-ad9b-7e4533ee1aab admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=f8752981b8bd4eb48dd8d379433afb8f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2426336 Jun 17 10:59:25.231321 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e2256b-b4a5-4df4-ad9b-7e4533ee1aab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7d0f044-ed10-429e-8199-bdac4e4a1070,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:25.233528 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59234) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:25.234112 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.234724 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe073c84-4c20-49e4-ae78-7041eb4efbf9 None None] Network c023b3d2-1cce-4601-83dd-4d081666866f requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:25.235818 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-35e2256b-b4a5-4df4-ad9b-7e4533ee1aab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:25.257330 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'Port': ['ID=72b90c9a-f7fd-4fb7-b295-89a14b662c32,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:25.257330 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:25.277744 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.9463801 Jun 17 10:59:25.282946 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9071c938-f90d-4d60-a132-fd712629f998 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.303410 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9071c938-f90d-4d60-a132-fd712629f998 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.357813 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.7596564 Jun 17 10:59:25.365811 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc895c31-3871-447e-8f6a-844d444e960d None None] Network c023b3d2-1cce-4601-83dd-4d081666866f requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:25.385891 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.387765 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.1205044 Jun 17 10:59:25.454640 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9071c938-f90d-4d60-a132-fd712629f998 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.457520 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9071c938-f90d-4d60-a132-fd712629f998 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.458626 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-9071c938-f90d-4d60-a132-fd712629f998 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/f7d0f044-ed10-429e-8199-bdac4e4a1070 HTTP/1.1" status: 204 len: 168 time: 0.2239392 Jun 17 10:59:25.459610 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:25.468106 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9071c938-f90d-4d60-a132-fd712629f998 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7d0f044-ed10-429e-8199-bdac4e4a1070,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:25.470555 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9071c938-f90d-4d60-a132-fd712629f998 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:25.494141 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59242) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:25.552161 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_v2 [None req-72247979-dfc8-4e28-8d14-cc49c01afd64 admin admin] Deleting subnet a774e886-2986-4097-8f2c-20011a4f6feb {{(pid=110214) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 10:59:25.556276 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-72247979-dfc8-4e28-8d14-cc49c01afd64 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.594137 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-72247979-dfc8-4e28-8d14-cc49c01afd64 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.604073 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-72247979-dfc8-4e28-8d14-cc49c01afd64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.643172 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-09c7014e-409d-405c-b541-ba2076fa1391 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?name=tempest-securitygroup--1377006573&fields=id&tenant_id=f15e97a8adc74580bf4df14ed664fc3f HTTP/1.1" status: 200 len: 267 time: 0.0443344 Jun 17 10:59:25.735057 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-72247979-dfc8-4e28-8d14-cc49c01afd64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485'] for subnet, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.738393 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:25.750138 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-34432862-88de-4fbc-b94a-ed397bf39dfa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:25.751851 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-34432862-88de-4fbc-b94a-ed397bf39dfa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 810 time: 0.1016815 Jun 17 10:59:25.766136 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-04e3a239-5037-4ec5-a2dc-1aaf3f938de0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/quotas/f15e97a8adc74580bf4df14ed664fc3f HTTP/1.1" status: 200 len: 375 time: 0.0088930 Jun 17 10:59:25.768815 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-72247979-dfc8-4e28-8d14-cc49c01afd64 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.772088 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-72247979-dfc8-4e28-8d14-cc49c01afd64 admin admin] 10.222.0.41 "DELETE /v2.0/subnets/a774e886-2986-4097-8f2c-20011a4f6feb HTTP/1.1" status: 204 len: 168 time: 0.2768416 Jun 17 10:59:25.774117 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72247979-dfc8-4e28-8d14-cc49c01afd64 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a774e886-2986-4097-8f2c-20011a4f6feb,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:25.776995 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-72247979-dfc8-4e28-8d14-cc49c01afd64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:25.777592 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59254) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:25.828132 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.25', 49867) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:25.833068 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-f6c97bb2-afac-4ad2-8798-6554f66b43ca tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110215) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 10:59:25.833986 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-f6c97bb2-afac-4ad2-8798-6554f66b43ca tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0051785 Jun 17 10:59:25.850179 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.927731 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device a33b3689-e1bb-4011-a6d6-f16dff180486 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:59:25.991409 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port a33b3689-e1bb-4011-a6d6-f16dff180486 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:25.992272 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:25.997599 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.020565 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.021010 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.021853 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.022271 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > port after_create 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.023437 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > port after_delete 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.023994 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > port after_update 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.024535 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.025039 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.025538 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.026037 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.053251 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-ff6713be-f78b-41c5-a5f4-08563e015c12 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2816293 Jun 17 10:59:26.189307 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-8fe2481b-4d08-4c18-81e3-8ea10fc47950 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:26.194791 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-8fe2481b-4d08-4c18-81e3-8ea10fc47950 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 814 time: 0.3598142 Jun 17 10:59:26.204279 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.204852 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.205401 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.206087 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=110214) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:26.206461 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab']}} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:26.229940 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-c9ce2e35-55aa-4597-9c80-0c500afe163f service neutron] 10.222.0.41 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1427045 Jun 17 10:59:26.255833 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4ed126a2-0a5d-40fb-a4a3-21fc45e72c58 req-0353bc8d-d5d6-4fe1-8639-8b1178ba4b85 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.2397671 Jun 17 10:59:26.264666 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '52ec7769-4f5e-44f8-b467-c0285cb06fd1') {'for_net_delete': True} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:26.265138 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '52ec7769-4f5e-44f8-b467-c0285cb06fd1') {} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:26.294546 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6228436'] for segment, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.317181 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.327319 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Releasing vlan 131 on physical network physnet1 to pool {{(pid=110214) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6239464'] for segment, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: from cryptography.utils import int_from_bytes Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: from cryptography.utils import int_from_bytes Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: retrieve_revision_numbers = { Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: conditions |= (models_v2.Port.network_id.in_( Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: Traceback (most recent call last): Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: timer() Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: cb(*args, **kw) Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: return func(*args, **kwargs) Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: self._notify() Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: self.callback(batched_events) Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: event.method(event) Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: return f(self, *a, **k) Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._get(url).json() Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: return self.request(url, 'GET', **kwargs) Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 10:59:26.335639 dv-cinder-773870-6-iscsi neutron-server[110214]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 10:59:26.337622 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-2b056394-7661-46a7-8461-21511777e49e service neutron] 10.222.0.41 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1066632 Jun 17 10:59:26.452582 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.469689 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-3fb4bc50-737b-4da8-92f0-24822c2938ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:26.599868 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.602276 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] 10.222.0.41 "DELETE /v2.0/networks/c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab HTTP/1.1" status: 204 len: 168 time: 0.8236330 Jun 17 10:59:26.605181 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59288) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:26.618334 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0188f639-f6af-4ba9-b611-52271a463344 req-211714e5-3e91-47bc-a16b-4b8db256eedb tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:26.623354 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0188f639-f6af-4ba9-b611-52271a463344 req-211714e5-3e91-47bc-a16b-4b8db256eedb tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 931 time: 0.2360277 Jun 17 10:59:26.624950 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Pushing event deleted for resources: {'Network': ['ID=c6b1aaca-15c2-4ffe-b8ee-3ac37bbe8aab,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:26.628461 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:26.700457 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0188f639-f6af-4ba9-b611-52271a463344 req-1317ca50-4caa-4464-928b-50e2d330911b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731187 Jun 17 10:59:26.703848 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-38b80d35-0812-4986-babb-5a174c864863 req-4620cac3-7c26-46af-ad7f-232f7e626096 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 210 time: 0.0490546 Jun 17 10:59:26.728971 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_v2 [None req-8fc77c07-8e18-447c-9cd4-7731a3f2f61a admin admin] Deleting subnet 1c33d4d9-7bdf-4100-a73f-7ef1758ff938 {{(pid=110215) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 10:59:26.732865 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fc77c07-8e18-447c-9cd4-7731a3f2f61a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.765858 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59296) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:26.772450 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fc77c07-8e18-447c-9cd4-7731a3f2f61a admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.783243 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fc77c07-8e18-447c-9cd4-7731a3f2f61a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.785892 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.868598 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1029885131-network', 'tenant_id': '467d78e8abb1441fa92c4f6d79a58e67'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:26.917322 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fc77c07-8e18-447c-9cd4-7731a3f2f61a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485'] for subnet, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.920310 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:26.948230 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fc77c07-8e18-447c-9cd4-7731a3f2f61a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1c33d4d9-7bdf-4100-a73f-7ef1758ff938,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:26.950147 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fc77c07-8e18-447c-9cd4-7731a3f2f61a admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:26.952112 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-8fc77c07-8e18-447c-9cd4-7731a3f2f61a admin admin] 10.222.0.41 "DELETE /v2.0/subnets/1c33d4d9-7bdf-4100-a73f-7ef1758ff938 HTTP/1.1" status: 204 len: 168 time: 0.3448281 Jun 17 10:59:26.952876 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8fc77c07-8e18-447c-9cd4-7731a3f2f61a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:26.954364 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59300) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:27.014099 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Made reservation on behalf of 467d78e8abb1441fa92c4f6d79a58e67 for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:27.016375 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.029275 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.031116 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.144738 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.161054 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.161430 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.162197 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.162540 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > port after_create 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.162906 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > port after_delete 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.163784 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > port after_update 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.164104 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.164420 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.164731 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.165041 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.328083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.328650 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.329017 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.329118 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=110215) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Jun 17 10:59:27.329483 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c023b3d2-1cce-4601-83dd-4d081666866f']}} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:27.343068 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Request body: {'port': {'device_id': '6e6129b0-030d-4abe-90f0-dea76231bc08', 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b', 'admin_state_up': True, 'tenant_id': '5a3d5a50b1194ca594e398fd941cbe5f'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:27.383240 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a5391947-cede-4558-bd2b-b8cf4eb4ebb6') {'for_net_delete': True} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:27.383622 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a5391947-cede-4558-bd2b-b8cf4eb4ebb6') {} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 10:59:27.409886 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6032818'] for segment, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.426334 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6ed101c2-2afd-4b1f-8cfa-3fcb5a476b73 req-fb13e14d-7a34-49fc-8ffe-d64f3505e217 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.0295486 Jun 17 10:59:27.447864 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Request body: {'port': {'device_id': 'cf72262e-dfa5-4b03-b340-7b31fd5ecec6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:27.497615 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.529632 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Releasing vlan 141 on physical network physnet1 to pool {{(pid=110215) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 10:59:27.530029 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5898799'] for segment, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: from cryptography.utils import int_from_bytes Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: from cryptography.utils import int_from_bytes Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: Traceback (most recent call last): Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: timer() Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: cb(*args, **kw) Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: return func(*args, **kwargs) Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: self._notify() Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: self.callback(batched_events) Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: event.method(event) Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: return f(self, *a, **k) Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._get(url).json() Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: return self.request(url, 'GET', **kwargs) Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 10:59:27.533840 dv-cinder-773870-6-iscsi neutron-server[110215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 10:59:27.553611 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.646415 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.661170 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f43ac758-0a0d-42ae-9816-5dc338bc2b54 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b49b10d8-4dfb-484f-9b3d-45b8c1653667,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=110215) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Added segment 7fc7865d-5397-411f-a202-d852a3759824 of type vlan for network 61bd7470-9de2-46ad-a73c-0c5a775b3c55 Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] 10.222.0.41 "DELETE /v2.0/networks/c023b3d2-1cce-4601-83dd-4d081666866f HTTP/1.1" status: 204 len: 168 time: 0.8932879 Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Pushing event deleted for resources: {'Network': ['ID=c023b3d2-1cce-4601-83dd-4d081666866f,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:27.935083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:27.967336 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1609401-0025-4da6-b1ef-d791186bd55b req-65c8af15-e603-4bcf-9d64-6fde941588a2 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:27.973285 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e1609401-0025-4da6-b1ef-d791186bd55b req-65c8af15-e603-4bcf-9d64-6fde941588a2 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 931 time: 0.1197405 Jun 17 10:59:28.015609 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Made reservation on behalf of 5a3d5a50b1194ca594e398fd941cbe5f for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:28.021536 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:28.026211 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4bceabe0-91dd-463b-99f7-7ab38fc3b8a0 req-d8050b37-8df3-4dfd-97c4-ecb6e38e6340 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 210 time: 0.1810548 Jun 17 10:59:28.029535 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e1609401-0025-4da6-b1ef-d791186bd55b req-7677a503-75f4-4902-88a3-a89cb1838592 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461495 Jun 17 10:59:28.086224 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:28.223260 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59350) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:28.301210 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-c32e622f-f4e8-4dc4-a79a-b8603f4e0b25 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=5bad3fa49531495d8f0a3178ce25d4d5&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0767102 Jun 17 10:59:28.303692 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59354) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:28.369582 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:28.379116 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0df87529-b305-4eac-bec0-40610210366d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:28.387965 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:28.393523 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:28.402573 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:28.415051 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0df87529-b305-4eac-bec0-40610210366d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:28.463917 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Allocated IP 172.20.0.4 (bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b/c10bc074-5591-4fbf-953f-e4097d48cc79/5df2bc70-d7c4-4355-b3d7-81d2732dfd9d) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 10:59:28.546525 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Pushing event updated for resources: {'Network': ['ID=61bd7470-9de2-46ad-a73c-0c5a775b3c55,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:28.554464 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.7869360 Jun 17 10:59:28.555660 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:28.558314 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59368) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:28.563484 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network 61bd7470-9de2-46ad-a73c-0c5a775b3c55 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 10:59:28.578573 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 879bb19b-66f7-48e8-83ce-097684433ad0 {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 10:59:28.586395 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Request body: {'subnet': {'network_id': '61bd7470-9de2-46ad-a73c-0c5a775b3c55', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1029885131-subnet', 'tenant_id': '467d78e8abb1441fa92c4f6d79a58e67', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:28.588571 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:28.622660 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0df87529-b305-4eac-bec0-40610210366d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:28.630686 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Transition to ACTIVE for port object 879bb19b-66f7-48e8-83ce-097684433ad0 will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:59:28.738557 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0df87529-b305-4eac-bec0-40610210366d admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:28.740486 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-0df87529-b305-4eac-bec0-40610210366d admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/13abde0f-a229-4e17-b594-f532c0ebf32c HTTP/1.1" status: 204 len: 168 time: 0.4350913 Jun 17 10:59:28.742402 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-8d51c329-5082-4174-90b2-af33a87e706e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:28.761069 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:28.762430 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-26ad8cd0-e485-4eae-938b-8412490af413 req-f7f8fc3e-4182-4726-9575-065002e40b9d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.1489859 Jun 17 10:59:28.780904 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0df87529-b305-4eac-bec0-40610210366d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=13abde0f-a229-4e17-b594-f532c0ebf32c,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:28.796307 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0df87529-b305-4eac-bec0-40610210366d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:28.807142 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:28.825572 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Made reservation on behalf of 467d78e8abb1441fa92c4f6d79a58e67 for: {'subnet': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:28.833490 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5529992'] for subnet, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:29.203466 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6239242', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5530010'] for subnet, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:29.207727 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:29.326513 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f33646c1-ae39-45b5-8ace-aac4e2cac929 req-5f89cacb-fda1-4ba4-89ca-bcdbb5e42d8f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 210 time: 0.1027412 Jun 17 10:59:29.457839 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Pushing event updated for resources: {'Port': ['ID=879bb19b-66f7-48e8-83ce-097684433ad0,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:29.483690 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.694s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:29.515387 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Checking segment: {'id': '7fc7865d-5397-411f-a202-d852a3759824', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '61bd7470-9de2-46ad-a73c-0c5a775b3c55'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110214) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:29.524178 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Network hostable DHCP agents. Network: 61bd7470-9de2-46ad-a73c-0c5a775b3c55, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110214) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 10:59:29.534872 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:29.541177 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Pushing event updated for resources: {'Subnet': ['ID=07c3aa71-3bf0-4bb5-90f7-6a0307254f38,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:29.550533 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.343s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:29.626412 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Attempting to bind port 879bb19b-66f7-48e8-83ce-097684433ad0 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 10:59:29.626412 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Attempting to bind port 879bb19b-66f7-48e8-83ce-097684433ad0 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': '12145aeb-cad3-4041-a8a6-2c52a27c3eb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'e30545f7-6269-420b-a870-c56fe4fa7478'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 10:59:29.626412 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Attempting to bind port 879bb19b-66f7-48e8-83ce-097684433ad0 on network e30545f7-6269-420b-a870-c56fe4fa7478 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:59:29.637417 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Network 61bd7470-9de2-46ad-a73c-0c5a775b3c55 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110214) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 10:59:29.657396 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Port 879bb19b-66f7-48e8-83ce-097684433ad0 on network e30545f7-6269-420b-a870-c56fe4fa7478 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 10:59:29.657725 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Attempting to bind port 879bb19b-66f7-48e8-83ce-097684433ad0 on network e30545f7-6269-420b-a870-c56fe4fa7478 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:59:29.691203 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 10, 59, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 10:59:29.691768 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Checking segment: {'id': '12145aeb-cad3-4041-a8a6-2c52a27c3eb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'e30545f7-6269-420b-a870-c56fe4fa7478'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:29.692499 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Bound using segment: {'id': '12145aeb-cad3-4041-a8a6-2c52a27c3eb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'e30545f7-6269-420b-a870-c56fe4fa7478'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 10:59:29.693181 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Bound port: 879bb19b-66f7-48e8-83ce-097684433ad0, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '12145aeb-cad3-4041-a8a6-2c52a27c3eb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'e30545f7-6269-420b-a870-c56fe4fa7478'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 10:59:29.693745 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:29.766463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:29.777631 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, 61bd7470-9de2-46ad-a73c-0c5a775b3c55) {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:29.785930 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:29.786636 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:29.799108 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bdb9c88-61bb-4404-9c0e-1abd593bf4e9 None None] Network 61bd7470-9de2-46ad-a73c-0c5a775b3c55 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:29.821087 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:29.905163 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59404) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:29.914412 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-5329eca3-da26-4b0e-bd23-3e79dbb8e0ad admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.3541911 Jun 17 10:59:29.966745 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ed0205-b8d3-4381-8de1-00ff75f633bc req-409c9dbf-3902-4faf-81c8-ae7cffb62cf1 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:29.968917 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-44ed0205-b8d3-4381-8de1-00ff75f633bc req-409c9dbf-3902-4faf-81c8-ae7cffb62cf1 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.2629447 Jun 17 10:59:29.973960 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:59:29.994921 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:30.000938 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 10:59:30.020686 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-f6dad6de-c27b-4a94-a51a-0c38c3dbd2bb admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=36ea45849e644418a884a10a0dd31410&name=default HTTP/1.1" status: 200 len: 2975 time: 0.1079130 Jun 17 10:59:30.023325 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] For port 879bb19b-66f7-48e8-83ce-097684433ad0, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 10:59:30.023801 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59410) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:30.065527 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0c4beef-e15d-46c8-93aa-1f0f732bf594 None None] Network 61bd7470-9de2-46ad-a73c-0c5a775b3c55 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:30.112502 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.25', 49882) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:30.113103 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59416) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:30.173234 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-44ed0205-b8d3-4381-8de1-00ff75f633bc req-9359d031-50e9-42df-8a1a-19fb7ef67700 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1462197 Jun 17 10:59:30.226461 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f910ec9b-aff5-4739-9c5d-d994a6f01789 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:30.265324 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] For port 879bb19b-66f7-48e8-83ce-097684433ad0, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=879bb19b-66f7-48e8-83ce-097684433ad0,segment=NetworkSegment(12145aeb-cad3-4041-a8a6-2c52a27c3eb7),segment_id=12145aeb-cad3-4041-a8a6-2c52a27c3eb7)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 10:59:30.276835 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f910ec9b-aff5-4739-9c5d-d994a6f01789 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:30.343746 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Pushing event updated for resources: {'Port': ['ID=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:30.361860 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.540s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:30.375480 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:30.437964 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:30.438812 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:30.471354 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:30.520270 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6d48eea2-f433-49ca-b1ad-d6b3e5c9fc0f admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:30.593618 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:30.594775 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:30.596531 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] 10.222.0.25 "PUT /v2.0/ports/879bb19b-66f7-48e8-83ce-097684433ad0 HTTP/1.1" status: 200 len: 1093 time: 3.2588699 Jun 17 10:59:30.608721 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cf72262e-dfa5-4b03-b340-7b31fd5ecec6', 'tag': '879bb19b-66f7-48e8-83ce-097684433ad0'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 10:59:30.697506 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5c12f02-bda1-4afd-97b6-2df11d3e8335 req-ce1cb8b3-aeb5-477b-a009-06270ea4f670 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:30.707371 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d5c12f02-bda1-4afd-97b6-2df11d3e8335 req-ce1cb8b3-aeb5-477b-a009-06270ea4f670 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 931 time: 0.5790825 Jun 17 10:59:30.755152 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Pushing event updated for resources: {'Port': ['ID=879bb19b-66f7-48e8-83ce-097684433ad0,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:30.760643 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7f788cc5-a10b-42fc-835f-3b339758c021 req-b2265143-0175-4eb2-95ce-e68d0f79e3c0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 210 time: 0.1325905 Jun 17 10:59:30.774257 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.303s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:30.830874 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-a8a47291-0427-4032-b574-10cadcc67bf6 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:30.833589 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-a8a47291-0427-4032-b574-10cadcc67bf6 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.25 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 810 time: 0.5515335 Jun 17 10:59:30.837393 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f25d2716-2208-491d-8140-7ee6f2d2cb53" -d '{"events": [{"name": "network-changed", "server_uuid": "cf72262e-dfa5-4b03-b340-7b31fd5ecec6", "tag": "879bb19b-66f7-48e8-83ce-097684433ad0"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 10:59:30.843233 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d5c12f02-bda1-4afd-97b6-2df11d3e8335 req-cc27358c-7c43-46eb-9c44-dfa7b3c1904d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1308029 Jun 17 10:59:30.869147 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-e32748d3-2ee8-4585-865f-80027e049c41 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.5318885 Jun 17 10:59:30.913512 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f910ec9b-aff5-4739-9c5d-d994a6f01789 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:30.917933 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f910ec9b-aff5-4739-9c5d-d994a6f01789 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:30.919252 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-f910ec9b-aff5-4739-9c5d-d994a6f01789 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/e2430b9d-8f6e-4222-909c-9907f3311207 HTTP/1.1" status: 204 len: 168 time: 0.8917506 Jun 17 10:59:30.922309 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:30.968472 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f910ec9b-aff5-4739-9c5d-d994a6f01789 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2430b9d-8f6e-4222-909c-9907f3311207,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:30.986678 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f910ec9b-aff5-4739-9c5d-d994a6f01789 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:31.076718 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6d48eea2-f433-49ca-b1ad-d6b3e5c9fc0f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:31.077455 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Request body: {'port': {'device_id': '6e6129b0-030d-4abe-90f0-dea76231bc08', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:31.243245 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-9084b1da-7429-4b0b-bac7-e973933f8f6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f15e97a8adc74580bf4df14ed664fc3f HTTP/1.1" status: 200 len: 380 time: 0.2046058 Jun 17 10:59:31.275848 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 10:59:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-413b077d-f021-4553-9316-0d68abc416b5 x-openstack-request-id: req-413b077d-f021-4553-9316-0d68abc416b5 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 10:59:31.276155 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cf72262e-dfa5-4b03-b340-7b31fd5ecec6", "tag": "879bb19b-66f7-48e8-83ce-097684433ad0", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 10:59:31.276424 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-413b077d-f021-4553-9316-0d68abc416b5 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 10:59:31.276895 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cf72262e-dfa5-4b03-b340-7b31fd5ecec6', 'tag': '879bb19b-66f7-48e8-83ce-097684433ad0', 'status': 'completed', 'code': 200} Jun 17 10:59:31.282268 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6d48eea2-f433-49ca-b1ad-d6b3e5c9fc0f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:31.287201 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f910ec9b-aff5-4739-9c5d-d994a6f01789 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:31.310050 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:31.328542 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16568e87-47a4-42ed-932e-71013903a7ce req-45541128-dfab-4424-a611-b2436cf6972d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:31.335880 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-45541128-dfab-4424-a611-b2436cf6972d service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=95dd44ce5be843a295db7140aba1fb25&device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 1096 time: 0.2009885 Jun 17 10:59:31.379525 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-6d48eea2-f433-49ca-b1ad-d6b3e5c9fc0f admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=5f3d599e8a174ec5ab92bff6fe9b6bda&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2646878 Jun 17 10:59:31.383576 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59468) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:31.401212 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d48eea2-f433-49ca-b1ad-d6b3e5c9fc0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73e6ff45-98b2-4ba6-b9dd-a7e1514ea487,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:31.456592 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6d48eea2-f433-49ca-b1ad-d6b3e5c9fc0f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:31.562067 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0a175a7b-57fe-4ce0-8649-a56387b62626 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:31.603221 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0a175a7b-57fe-4ce0-8649-a56387b62626 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:31.641492 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'port': {'device_id': '0878d13b-20f2-49ea-8fe7-94094628f250', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'admin_state_up': True, 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'security_groups': ['b02c5682-d2cc-40d2-81a5-81d43f06e80d']}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:31.896114 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0a175a7b-57fe-4ce0-8649-a56387b62626 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:31.985417 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59500) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:32.004345 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-efd712bc-6e9f-4c05-82f6-fbf7e0cd1465 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=879bb19b-66f7-48e8-83ce-097684433ad0 HTTP/1.1" status: 200 len: 217 time: 0.3779769 Jun 17 10:59:32.010411 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0a175a7b-57fe-4ce0-8649-a56387b62626 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:32.016142 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-0a175a7b-57fe-4ce0-8649-a56387b62626 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/73e6ff45-98b2-4ba6-b9dd-a7e1514ea487 HTTP/1.1" status: 204 len: 168 time: 0.6315017 Jun 17 10:59:32.016859 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:32.045242 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-2073376897-network', 'tenant_id': '9b5534862d8f4252bbab968b49bb2187'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:32.109448 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4dc05f6-c1d0-404c-a2cd-15783aa16b6d req-0b7be523-0dad-48f0-a541-ac10f782edf8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:32.114043 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e4dc05f6-c1d0-404c-a2cd-15783aa16b6d req-0b7be523-0dad-48f0-a541-ac10f782edf8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.5644312 Jun 17 10:59:32.184441 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e4dc05f6-c1d0-404c-a2cd-15783aa16b6d req-0c0fc58c-3e1e-40da-a063-816a4d2b204e tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693207 Jun 17 10:59:32.198834 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a175a7b-57fe-4ce0-8649-a56387b62626 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73e6ff45-98b2-4ba6-b9dd-a7e1514ea487,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:32.238684 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7c499b4e-2103-4296-96ab-f93b80d4b122 req-71917510-35fa-4bbe-9c61-e23ffe82dcca tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 210 time: 0.2391000 Jun 17 10:59:32.247157 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0a175a7b-57fe-4ce0-8649-a56387b62626 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:32.375308 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Made reservation on behalf of 9b5534862d8f4252bbab968b49bb2187 for: {'network': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:32.375308 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:32.402874 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 10:59:32.405771 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:32.428806 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:32.451523 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16568e87-47a4-42ed-932e-71013903a7ce req-9911d6b9-8967-4e47-ae6b-e8d9f7ce3376 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:32.451523 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-9911d6b9-8967-4e47-ae6b-e8d9f7ce3376 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=556ccdca-d712-410a-a954-c43564443811 HTTP/1.1" status: 200 len: 852 time: 0.1197808 Jun 17 10:59:32.494236 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Transition to ACTIVE for port object 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:59:32.539785 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-8fdbc4e1-7021-46c2-9e64-e1499c6e3dea service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e30545f7-6269-420b-a870-c56fe4fa7478&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0820034 Jun 17 10:59:32.559295 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Made reservation on behalf of f15e97a8adc74580bf4df14ed664fc3f for: {'port': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:32.564409 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:32.626024 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:32.655534 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d078cc6b-f4d1-4a9e-9b3e-e3d09dc984f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:32.930322 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Pushing event updated for resources: {'Port': ['ID=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:32.942155 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:32.974542 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-0bfdaa74-3556-4c04-ad60-25db37bf2919 service neutron] 10.222.0.25 "GET /v2.0/networks/e30545f7-6269-420b-a870-c56fe4fa7478?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4085212 Jun 17 10:59:33.125400 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Attempting to bind port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 10:59:33.126431 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Attempting to bind port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 10:59:33.126431 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Attempting to bind port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:59:33.134952 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Allocated IP 172.20.0.4 (54973ccd-0b2b-4517-ad28-76a3128a2da3/b70c69a2-cf24-49e5-90dd-a210bd42e6bb/584d5dfc-3f46-4820-80b2-e729ce075654) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 10:59:33.145803 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 10:59:33.146086 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Attempting to bind port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:59:33.194255 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 10, 59, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 10:59:33.198750 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Checking segment: {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:33.198750 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Bound using segment: {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 10:59:33.198750 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Bound port: 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 10:59:33.198750 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:33.214455 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-423a779f-5555-42cc-8b14-a6dc10ded529 req-1a5fe9e6-3e8e-4b52-b3b4-e067731cc4e5 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:33.218542 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-423a779f-5555-42cc-8b14-a6dc10ded529 req-1a5fe9e6-3e8e-4b52-b3b4-e067731cc4e5 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 931 time: 0.7126772 Jun 17 10:59:33.270695 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16568e87-47a4-42ed-932e-71013903a7ce req-6ce89dfc-0a9a-447c-8083-5cb8983cd595 service neutron] 10.222.0.25 "GET /v2.0/networks/e30545f7-6269-420b-a870-c56fe4fa7478?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1912415 Jun 17 10:59:33.300582 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:33.331447 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] For port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 10:59:33.342049 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] For port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 10:59:33.394474 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:33.434520 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:33.434520 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3aea8088-dfa8-49db-85b0-f4ba726425e8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:33.576605 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:33.577456 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:33.581014 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] 10.222.0.25 "PUT /v2.0/ports/5df2bc70-d7c4-4355-b3d7-81d2732dfd9d HTTP/1.1" status: 200 len: 1093 time: 2.5125890 Jun 17 10:59:33.585180 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6e6129b0-030d-4abe-90f0-dea76231bc08', 'tag': '5df2bc70-d7c4-4355-b3d7-81d2732dfd9d'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 10:59:33.596110 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-64959dfc-9e16-4e01-8803-8726eaafb375" -d '{"events": [{"name": "network-changed", "server_uuid": "6e6129b0-030d-4abe-90f0-dea76231bc08", "tag": "5df2bc70-d7c4-4355-b3d7-81d2732dfd9d"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 10:59:33.660751 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-423a779f-5555-42cc-8b14-a6dc10ded529 req-a125ae8b-6b7a-4318-9eb7-c4855c770c97 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4219246 Jun 17 10:59:33.668426 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:33.693322 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Pushing event updated for resources: {'Port': ['ID=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:33.700708 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.266s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:33.805050 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] vlan segment allocate from pool success with {'vlan_id': 134, 'physical_network': 'physnet1'} {{(pid=110214) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 10:59:33.845298 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2cb1ac47-e5c3-4c7e-8e5a-629be5de5810,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:33.867059 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:33.876125 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:33.886387 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:33.886731 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.segments_db [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Added segment a21035cd-067b-49c3-a0b1-142ba9def056 of type vlan for network 3984fc37-eb92-40cf-b691-87dfc8d275f1 Jun 17 10:59:33.978194 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.provisioning_blocks [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Transition to ACTIVE for port object 584d5dfc-3f46-4820-80b2-e729ce075654 will not be triggered until provisioned by entity DHCP. {{(pid=110214) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:59:34.001340 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9f45332c-fdf4-4786-a244-b65da2b88c3f req-d9470569-0270-4130-9871-872d4a8a4a31 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 210 time: 0.0760179 Jun 17 10:59:34.017187 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:34.117086 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:34.118637 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:34.123873 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:34.128276 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5889ce55-8b24-47a9-9f1a-4c935c90fb33 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:34.254100 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Pushing event updated for resources: {'Network': ['ID=3984fc37-eb92-40cf-b691-87dfc8d275f1,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:34.260939 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:34.268031 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network 3984fc37-eb92-40cf-b691-87dfc8d275f1 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 10:59:34.293370 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:34.321400 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:34.406486 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 10:59:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4063675e-e2e0-4059-975e-833b19c0443e x-openstack-request-id: req-4063675e-e2e0-4059-975e-833b19c0443e {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 10:59:34.407046 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6e6129b0-030d-4abe-90f0-dea76231bc08", "tag": "5df2bc70-d7c4-4355-b3d7-81d2732dfd9d", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 10:59:34.407130 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-4063675e-e2e0-4059-975e-833b19c0443e {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 10:59:34.409159 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6e6129b0-030d-4abe-90f0-dea76231bc08', 'tag': '5df2bc70-d7c4-4355-b3d7-81d2732dfd9d', 'status': 'completed', 'code': 200} Jun 17 10:59:34.445257 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6319385b-bf4e-4c83-a324-9a2b00fae23a req-c89854bd-5c69-478d-a23d-4b9c609e8661 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:34.446961 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 2.4129577 Jun 17 10:59:34.455916 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6319385b-bf4e-4c83-a324-9a2b00fae23a req-c89854bd-5c69-478d-a23d-4b9c609e8661 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.9511163 Jun 17 10:59:34.458980 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59604) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:34.474629 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:34.485335 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Network 54973ccd-0b2b-4517-ad28-76a3128a2da3 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 10:59:34.495822 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:34.501133 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'Port': ['ID=584d5dfc-3f46-4820-80b2-e729ce075654,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:34.504105 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 10:59:34.507876 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:34.521325 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Request body: {'subnet': {'network_id': '3984fc37-eb92-40cf-b691-87dfc8d275f1', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-2073376897-subnet', 'tenant_id': '9b5534862d8f4252bbab968b49bb2187', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:34.590318 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25d2716-2208-491d-8140-7ee6f2d2cb53 req-474e79c5-06a5-4c54-a69c-871cef6eaa87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:34.590318 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f25d2716-2208-491d-8140-7ee6f2d2cb53 req-474e79c5-06a5-4c54-a69c-871cef6eaa87 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=95dd44ce5be843a295db7140aba1fb25&device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 1096 time: 0.9419520 Jun 17 10:59:34.603128 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-ef7d35be-4e47-48ef-a923-2bafc0c77785 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:34.604885 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-ef7d35be-4e47-48ef-a923-2bafc0c77785 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 1096 time: 0.8442950 Jun 17 10:59:34.629758 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:34.630428 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for port, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:34.633599 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6319385b-bf4e-4c83-a324-9a2b00fae23a req-699adca1-1e26-477d-b114-b9888cf4e83a tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1763730 Jun 17 10:59:34.675969 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Made reservation on behalf of 9b5534862d8f4252bbab968b49bb2187 for: {'subnet': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 10:59:34.679722 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5636039'] for subnet, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:34.730646 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.1039181 Jun 17 10:59:34.759243 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Request body: {'port': {'device_id': '0878d13b-20f2-49ea-8fe7-94094628f250', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 10:59:35.025164 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-4dd9e022-4b36-4de6-b535-c049c4f3eeda service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d HTTP/1.1" status: 200 len: 217 time: 0.2734966 Jun 17 10:59:35.099560 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-37c0f4b1-a263-4cf6-a572-08195563f20c None None] Provisioning for port 584d5dfc-3f46-4820-80b2-e729ce075654 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:59:35.104216 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-37c0f4b1-a263-4cf6-a572-08195563f20c None None] Provisioning complete for port 584d5dfc-3f46-4820-80b2-e729ce075654 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:35.104990 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-37c0f4b1-a263-4cf6-a572-08195563f20c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:35.119325 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:35.189879 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c6a1408-2b61-4437-a02c-f4c056489e1b req-48bb9623-e38f-4ffd-86f9-9d60451ac8b1 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:35.191199 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-37c0f4b1-a263-4cf6-a572-08195563f20c None None] Port 584d5dfc-3f46-4820-80b2-e729ce075654 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 10:59:35.197437 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9c6a1408-2b61-4437-a02c-f4c056489e1b req-48bb9623-e38f-4ffd-86f9-9d60451ac8b1 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 943 time: 0.2879777 Jun 17 10:59:35.214248 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-45bb2c93-cc2f-470e-b3a4-64585ed91947 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:35.215814 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-45bb2c93-cc2f-470e-b3a4-64585ed91947 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=c10bc074-5591-4fbf-953f-e4097d48cc79 HTTP/1.1" status: 200 len: 854 time: 0.1086097 Jun 17 10:59:35.308918 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-adf355d9-5e13-462d-8469-3d183f5a331d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0594518 Jun 17 10:59:35.377579 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9c6a1408-2b61-4437-a02c-f4c056489e1b req-ee122498-8b7f-491c-b160-502e11dcd773 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1791346 Jun 17 10:59:35.469050 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25d2716-2208-491d-8140-7ee6f2d2cb53 req-2738d43a-28b4-4061-a9e4-453583293be2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:35.470565 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f25d2716-2208-491d-8140-7ee6f2d2cb53 req-2738d43a-28b4-4061-a9e4-453583293be2 service neutron] 10.222.0.25 "GET /v2.0/networks?id=e30545f7-6269-420b-a870-c56fe4fa7478 HTTP/1.1" status: 200 len: 913 time: 0.8901706 Jun 17 10:59:35.568617 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-447e1f53-e8f8-479a-9800-1c25b37cc5c5 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2316766 Jun 17 10:59:35.571969 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f25d2716-2208-491d-8140-7ee6f2d2cb53 req-d9f2f889-5399-4fc6-bfa4-2ecaf9d8a730 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=879bb19b-66f7-48e8-83ce-097684433ad0 HTTP/1.1" status: 200 len: 217 time: 0.0848701 Jun 17 10:59:35.638925 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1dc72b5-19d0-45a1-98d3-b174362a7a3b req-dbb5c2a4-7f21-4c5c-99aa-d462912bdda9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:35.640695 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c1dc72b5-19d0-45a1-98d3-b174362a7a3b req-dbb5c2a4-7f21-4c5c-99aa-d462912bdda9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 931 time: 0.3284214 Jun 17 10:59:35.729310 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5898957', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5636053'] for subnet, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:35.807733 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 584d5dfc-3f46-4820-80b2-e729ce075654 {{(pid=110214) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 10:59:35.822355 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:35.844194 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.provisioning_blocks [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Transition to ACTIVE for port object 584d5dfc-3f46-4820-80b2-e729ce075654 will not be triggered until provisioned by entity L2. {{(pid=110214) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 10:59:35.855372 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f06fc9e6-a944-42c7-980e-4a77ecbf5069 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:35.920118 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c1dc72b5-19d0-45a1-98d3-b174362a7a3b req-5c4ac9ac-b284-4949-b2b9-9ac97cd0874c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2693481 Jun 17 10:59:35.949122 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25d2716-2208-491d-8140-7ee6f2d2cb53 req-c554c359-3486-4c5c-9091-2539979f0ec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:35.950581 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f25d2716-2208-491d-8140-7ee6f2d2cb53 req-c554c359-3486-4c5c-9091-2539979f0ec8 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=556ccdca-d712-410a-a954-c43564443811 HTTP/1.1" status: 200 len: 852 time: 0.2228298 Jun 17 10:59:35.986880 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:35.990117 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Checking segment: {'id': 'a21035cd-067b-49c3-a0b1-142ba9def056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '3984fc37-eb92-40cf-b691-87dfc8d275f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:35.990615 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Network hostable DHCP agents. Network: 3984fc37-eb92-40cf-b691-87dfc8d275f1, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110215) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 10:59:35.995032 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5db69b5d-4a92-40cd-9ebf-1dac732d7477 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:36.034032 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ae069949-6a04-4c6a-b60f-f21a64196304,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:36.043730 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f25d2716-2208-491d-8140-7ee6f2d2cb53 req-37398160-f505-4687-a5ad-fac5813421a5 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=e30545f7-6269-420b-a870-c56fe4fa7478&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0545905 Jun 17 10:59:36.050335 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:36.111992 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44ec40a7-5a79-4e21-aa1f-bb5187e0c954 req-0aa0523f-ad02-491f-be72-c42a88541c48 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3862596 Jun 17 10:59:36.215580 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Network 3984fc37-eb92-40cf-b691-87dfc8d275f1 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110215) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 10:59:36.233884 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Pushing event updated for resources: {'Port': ['ID=584d5dfc-3f46-4820-80b2-e729ce075654,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:36.246719 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:36.362004 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f25d2716-2208-491d-8140-7ee6f2d2cb53 req-e4a50924-125e-413f-9013-f8d2c9a135e3 service neutron] 10.222.0.25 "GET /v2.0/networks/e30545f7-6269-420b-a870-c56fe4fa7478?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2994783 Jun 17 10:59:36.362004 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, 3984fc37-eb92-40cf-b691-87dfc8d275f1) {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 10:59:36.363125 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f63a2a5c-9aad-46ec-b7fa-836d5db326bd req-da1afc23-2c18-43dc-a9b8-b3ea2b04549b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:36.370973 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:36.371785 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:36.379471 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-676ae366-8702-45db-8786-21503e6ead75 None None] Network 3984fc37-eb92-40cf-b691-87dfc8d275f1 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:36.381223 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f63a2a5c-9aad-46ec-b7fa-836d5db326bd req-da1afc23-2c18-43dc-a9b8-b3ea2b04549b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.4574594 Jun 17 10:59:36.418665 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64959dfc-9e16-4e01-8803-8726eaafb375 req-c2d19f6c-f504-4790-a841-b71bd6c24312 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:36.421359 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-64959dfc-9e16-4e01-8803-8726eaafb375 req-c2d19f6c-f504-4790-a841-b71bd6c24312 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 1096 time: 0.1397669 Jun 17 10:59:36.449589 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.9794002 Jun 17 10:59:36.655405 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f63a2a5c-9aad-46ec-b7fa-836d5db326bd req-f36b9671-b61a-4593-bbd4-fb0df8c40448 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2724314 Jun 17 10:59:36.687808 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.managers [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Attempting to bind port 584d5dfc-3f46-4820-80b2-e729ce075654 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 10:59:36.688854 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.managers [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Attempting to bind port 584d5dfc-3f46-4820-80b2-e729ce075654 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'}] {{(pid=110214) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 10:59:36.689351 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Attempting to bind port 584d5dfc-3f46-4820-80b2-e729ce075654 on network 54973ccd-0b2b-4517-ad28-76a3128a2da3 {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:59:36.694839 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Port 584d5dfc-3f46-4820-80b2-e729ce075654 on network 54973ccd-0b2b-4517-ad28-76a3128a2da3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 10:59:36.695346 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Attempting to bind port 584d5dfc-3f46-4820-80b2-e729ce075654 on network 54973ccd-0b2b-4517-ad28-76a3128a2da3 {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 10:59:36.701198 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 10, 59, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 10:59:36.704306 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Checking segment: {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110214) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 10:59:36.704306 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Bound using segment: {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'} {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 10:59:36.704306 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.managers [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Bound port: 584d5dfc-3f46-4820-80b2-e729ce075654, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'}}] {{(pid=110214) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 10:59:36.704306 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:36.857324 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-568f7981-4ff0-4952-91cb-f71b9ab6d3c1 None None] Network 3984fc37-eb92-40cf-b691-87dfc8d275f1 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 10:59:36.876269 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] For port 584d5dfc-3f46-4820-80b2-e729ce075654, host hv-cinder-77387, cleared binding levels {{(pid=110214) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 10:59:36.893161 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] For port 584d5dfc-3f46-4820-80b2-e729ce075654, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=584d5dfc-3f46-4820-80b2-e729ce075654,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110214) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 10:59:36.969096 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:36.973644 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:36.995913 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f25d2716-2208-491d-8140-7ee6f2d2cb53 req-b296a0da-5a41-40e9-aa67-4778672b782d service neutron] 10.222.0.25 "GET /v2.0/networks/e30545f7-6269-420b-a870-c56fe4fa7478?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5317671 Jun 17 10:59:37.017036 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64959dfc-9e16-4e01-8803-8726eaafb375 req-f98dbffc-d250-4a3a-8e75-edfeb70bbf16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:37.028797 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-64959dfc-9e16-4e01-8803-8726eaafb375 req-f98dbffc-d250-4a3a-8e75-edfeb70bbf16 service neutron] 10.222.0.25 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 915 time: 0.5470388 Jun 17 10:59:37.046502 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:37.047563 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for port, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:37.049245 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] 10.222.0.25 "PUT /v2.0/ports/584d5dfc-3f46-4820-80b2-e729ce075654 HTTP/1.1" status: 200 len: 1093 time: 2.2958891 Jun 17 10:59:37.049943 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0878d13b-20f2-49ea-8fe7-94094628f250', 'tag': '584d5dfc-3f46-4820-80b2-e729ce075654'}] {{(pid=110214) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 10:59:37.146156 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Pushing event updated for resources: {'Port': ['ID=584d5dfc-3f46-4820-80b2-e729ce075654,revision_number=3']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:37.164139 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:37.210576 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-64959dfc-9e16-4e01-8803-8726eaafb375 req-75b40b72-7c4e-4bd6-8227-8cb726fd9a7e service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d HTTP/1.1" status: 200 len: 217 time: 0.1435800 Jun 17 10:59:37.221842 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933df6c4-b193-40f4-9842-8293fbb37496 req-bb748cf5-f9e1-4603-90ec-b4de30847962 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:37.224057 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-933df6c4-b193-40f4-9842-8293fbb37496 req-bb748cf5-f9e1-4603-90ec-b4de30847962 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 943 time: 0.4640942 Jun 17 10:59:37.366461 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-933df6c4-b193-40f4-9842-8293fbb37496 req-0710f70e-2c47-40e9-9301-b65fd8be6307 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1326432 Jun 17 10:59:37.395433 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64959dfc-9e16-4e01-8803-8726eaafb375 req-728f5024-d6cf-43ad-8bcf-f8cdcf6b8ba9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:37.398563 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-64959dfc-9e16-4e01-8803-8726eaafb375 req-728f5024-d6cf-43ad-8bcf-f8cdcf6b8ba9 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=c10bc074-5591-4fbf-953f-e4097d48cc79 HTTP/1.1" status: 200 len: 854 time: 0.1102982 Jun 17 10:59:37.480515 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-64959dfc-9e16-4e01-8803-8726eaafb375 req-082d6a41-60b0-4d78-bbfd-247967e0b983 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0619984 Jun 17 10:59:37.531957 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd0da21-5195-43cc-a84f-5adc717a829b req-a13436c2-9f11-4222-b67b-2be7ba77f490 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:37.533774 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-dcd0da21-5195-43cc-a84f-5adc717a829b req-a13436c2-9f11-4222-b67b-2be7ba77f490 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 943 time: 0.3203123 Jun 17 10:59:37.554346 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-85093cd5-0ee7-4f23-aec4-cf3598e3ccdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:37.555955 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-85093cd5-0ee7-4f23-aec4-cf3598e3ccdb service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 1096 time: 0.2697251 Jun 17 10:59:37.606907 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-dcd0da21-5195-43cc-a84f-5adc717a829b req-04dcb907-76cb-45cf-8a48-f796f8b8b5e1 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0643582 Jun 17 10:59:37.613144 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59706) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:37.674003 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59710) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:37.841818 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cc2cf72888dbbd14a3b8c118b05d43e907687f619eecab2abc2da29781eba8b9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e5a661e4-b44d-47b5-9fb3-7148106435c2" -d '{"events": [{"name": "network-changed", "server_uuid": "0878d13b-20f2-49ea-8fe7-94094628f250", "tag": "584d5dfc-3f46-4820-80b2-e729ce075654"}]}' {{(pid=110214) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 10:59:38.353080 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-5b06f6b7-55aa-404c-914f-0d0769b35035 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=584d5dfc-3f46-4820-80b2-e729ce075654 HTTP/1.1" status: 200 len: 217 time: 0.1291552 Jun 17 10:59:38.393033 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-64959dfc-9e16-4e01-8803-8726eaafb375 req-92198ea2-42c8-4c08-a487-cad0b50d4fe4 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5302925 Jun 17 10:59:38.413421 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de9c8da-4ce3-4d73-a3a7-d6c0084db295 req-6efd635c-72fc-4a8b-80a3-66e5d125f66f tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:38.427115 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4de9c8da-4ce3-4d73-a3a7-d6c0084db295 req-6efd635c-72fc-4a8b-80a3-66e5d125f66f tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.5192988 Jun 17 10:59:38.429770 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59730) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:38.458755 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-56f12a8b-c6cf-424c-b21c-ccda0b07d0c5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:38.496257 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 10:59:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ca3cbf1-30c1-4589-b415-2099865f1d18 x-openstack-request-id: req-9ca3cbf1-30c1-4589-b415-2099865f1d18 {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 10:59:38.496745 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0878d13b-20f2-49ea-8fe7-94094628f250", "tag": "584d5dfc-3f46-4820-80b2-e729ce075654", "status": "completed", "code": 200}]} {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 10:59:38.497920 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-9ca3cbf1-30c1-4589-b415-2099865f1d18 {{(pid=110214) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 10:59:38.500944 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0878d13b-20f2-49ea-8fe7-94094628f250', 'tag': '584d5dfc-3f46-4820-80b2-e729ce075654', 'status': 'completed', 'code': 200} Jun 17 10:59:38.604073 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4de9c8da-4ce3-4d73-a3a7-d6c0084db295 req-72e71eec-07be-435f-9f87-912f8da88fa2 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1757803 Jun 17 10:59:38.670758 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-7145dd04-903a-4ce2-81f7-a9e499bc2d33 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:38.781658 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-64959dfc-9e16-4e01-8803-8726eaafb375 req-8129b670-36c1-4f18-9b1c-9c176f048a55 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3524694 Jun 17 10:59:38.855838 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-56f12a8b-c6cf-424c-b21c-ccda0b07d0c5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:38.871505 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-dc802179-06ba-4ac9-8c97-c6139b17df4a admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:38.909647 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-85744d70-fc48-44e5-b2bd-3a511fa8bab4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:38.911986 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-85744d70-fc48-44e5-b2bd-3a511fa8bab4 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 200 len: 849 time: 0.5400314 Jun 17 10:59:38.917029 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.db.api [None req-dc802179-06ba-4ac9-8c97-c6139b17df4a admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Jun 17 10:59:38.917029 dv-cinder-773870-6-iscsi neutron-server[110214]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Jun 17 10:59:38.917029 dv-cinder-773870-6-iscsi neutron-server[110214]: [parameters: {'project_id_1': '1e151355dc304c5198a2d074b9dac70e', 'expiration_1': datetime.datetime(2021, 6, 17, 10, 59, 38, 897653)}] Jun 17 10:59:38.917029 dv-cinder-773870-6-iscsi neutron-server[110214]: (Background on this error at: http://sqlalche.me/e/14/e3q8) {{(pid=110214) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Jun 17 10:59:38.918128 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_db.api [None req-dc802179-06ba-4ac9-8c97-c6139b17df4a admin admin] Performing DB retry for function neutron.db.securitygroups_db.SecurityGroupDbMixin.create_security_group {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jun 17 10:59:38.919813 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-56f12a8b-c6cf-424c-b21c-ccda0b07d0c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:38.946241 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf6ad47e-74ba-4df3-a909-73fb9d7e6487 req-af49415c-3be9-4854-9640-d3ba9a501002 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:38.954778 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-cf6ad47e-74ba-4df3-a909-73fb9d7e6487 req-af49415c-3be9-4854-9640-d3ba9a501002 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 943 time: 0.1265266 Jun 17 10:59:38.972810 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:39.005713 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-cf6ad47e-74ba-4df3-a909-73fb9d7e6487 req-86c1f2fd-b116-469f-80a0-bbb0564c3e08 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479159 Jun 17 10:59:39.036885 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835f8083-b258-4456-b514-f7db4fd27f96 req-a6b9a79d-a59d-4a95-ade2-c2030e5623b5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:39.038684 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-835f8083-b258-4456-b514-f7db4fd27f96 req-a6b9a79d-a59d-4a95-ade2-c2030e5623b5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 943 time: 0.1853960 Jun 17 10:59:39.066773 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-56f12a8b-c6cf-424c-b21c-ccda0b07d0c5 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=a916fdb75d834dde858763566b43baf4&name=default HTTP/1.1" status: 200 len: 2979 time: 1.4492702 Jun 17 10:59:39.067546 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59748) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:39.075269 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56f12a8b-c6cf-424c-b21c-ccda0b07d0c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc7b51d3-7e83-4d01-812b-0e51140124b8,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:39.078742 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-56f12a8b-c6cf-424c-b21c-ccda0b07d0c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:39.160717 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-835f8083-b258-4456-b514-f7db4fd27f96 req-1c4d711c-e7db-491b-8736-5634a53aeb55 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1060596 Jun 17 10:59:39.175736 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-7145dd04-903a-4ce2-81f7-a9e499bc2d33 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:39.217855 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13256a81-beb4-4b90-a807-90ad9322f498 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:39.243183 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13256a81-beb4-4b90-a807-90ad9322f498 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:39.288397 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-7145dd04-903a-4ce2-81f7-a9e499bc2d33 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:39.291634 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:39.335243 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-7145dd04-903a-4ce2-81f7-a9e499bc2d33 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=f08477f5ac604cb9ab344eec0f739621&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8965859 Jun 17 10:59:39.335501 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59752) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:39.336767 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7145dd04-903a-4ce2-81f7-a9e499bc2d33 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=292e1b7f-bdb2-4f18-ae43-15afbb480ec5,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:39.340243 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7145dd04-903a-4ce2-81f7-a9e499bc2d33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:39.405193 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13256a81-beb4-4b90-a807-90ad9322f498 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:39.412321 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13256a81-beb4-4b90-a807-90ad9322f498 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:39.415788 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-13256a81-beb4-4b90-a807-90ad9322f498 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/fc7b51d3-7e83-4d01-812b-0e51140124b8 HTTP/1.1" status: 204 len: 168 time: 0.3446546 Jun 17 10:59:39.416021 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:39.419519 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-dc802179-06ba-4ac9-8c97-c6139b17df4a admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:39.423192 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e9c491eb-de3c-4a48-a38c-b9aa539e29e7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:39.435801 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13256a81-beb4-4b90-a807-90ad9322f498 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc7b51d3-7e83-4d01-812b-0e51140124b8,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:39.438499 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-13256a81-beb4-4b90-a807-90ad9322f498 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:39.475729 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e9c491eb-de3c-4a48-a38c-b9aa539e29e7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:39.587683 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-dc802179-06ba-4ac9-8c97-c6139b17df4a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:39.835575 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a76dc1e0-b054-465c-a1cf-78a4459d571c req-367050f2-5353-4158-a241-e156fb6b6bf5 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:39.837093 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a76dc1e0-b054-465c-a1cf-78a4459d571c req-367050f2-5353-4158-a241-e156fb6b6bf5 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.1016915 Jun 17 10:59:39.909868 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a76dc1e0-b054-465c-a1cf-78a4459d571c req-e701d4ab-b7b5-444e-9e42-cb81fcc7acbe tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631359 Jun 17 10:59:40.261342 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ea25222-78e2-461e-a2cd-41289fa1a425 req-6d6a76e3-f15e-48a1-89b7-2488b4ec1631 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:40.284274 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5ea25222-78e2-461e-a2cd-41289fa1a425 req-6d6a76e3-f15e-48a1-89b7-2488b4ec1631 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 943 time: 0.1117337 Jun 17 10:59:40.323181 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5ea25222-78e2-461e-a2cd-41289fa1a425 req-c2b67ad5-35c4-4a6b-9db4-c6a352c232f8 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538929 Jun 17 10:59:40.393957 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89761bb2-1ea2-4167-abf4-78fcee08cd93 req-2da11dc5-35fd-4bf2-9cf5-6e41d35a13b2 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:40.395562 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-89761bb2-1ea2-4167-abf4-78fcee08cd93 req-2da11dc5-35fd-4bf2-9cf5-6e41d35a13b2 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 943 time: 0.1039190 Jun 17 10:59:40.440422 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-89761bb2-1ea2-4167-abf4-78fcee08cd93 req-99350730-91e7-4d92-a0b5-77c7ea907a86 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384221 Jun 17 10:59:40.551633 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-dc802179-06ba-4ac9-8c97-c6139b17df4a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:40.552598 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e9c491eb-de3c-4a48-a38c-b9aa539e29e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:40.555820 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:40.559576 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e9c491eb-de3c-4a48-a38c-b9aa539e29e7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:40.560688 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-e9c491eb-de3c-4a48-a38c-b9aa539e29e7 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/292e1b7f-bdb2-4f18-ae43-15afbb480ec5 HTTP/1.1" status: 204 len: 168 time: 1.2242358 Jun 17 10:59:40.600620 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-dc802179-06ba-4ac9-8c97-c6139b17df4a admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=1e151355dc304c5198a2d074b9dac70e&name=default HTTP/1.1" status: 200 len: 2979 time: 2.9239562 Jun 17 10:59:40.607943 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc802179-06ba-4ac9-8c97-c6139b17df4a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5d3fff4-45f6-4804-839a-15dd2a66aacb,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:40.607943 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59770) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:40.636305 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9c491eb-de3c-4a48-a38c-b9aa539e29e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=292e1b7f-bdb2-4f18-ae43-15afbb480ec5,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:40.640213 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e9c491eb-de3c-4a48-a38c-b9aa539e29e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:40.640638 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.078s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:40.640994 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:40.730445 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d83cef81-b6fc-4b15-8127-f90d386d1d3d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:40.772311 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d83cef81-b6fc-4b15-8127-f90d386d1d3d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:40.900157 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d83cef81-b6fc-4b15-8127-f90d386d1d3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:40.904639 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d83cef81-b6fc-4b15-8127-f90d386d1d3d admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:40.905945 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-d83cef81-b6fc-4b15-8127-f90d386d1d3d admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/f5d3fff4-45f6-4804-839a-15dd2a66aacb HTTP/1.1" status: 204 len: 168 time: 0.2989633 Jun 17 10:59:40.906932 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0a175a7b-57fe-4ce0-8649-a56387b62626 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:40.915735 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d83cef81-b6fc-4b15-8127-f90d386d1d3d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5d3fff4-45f6-4804-839a-15dd2a66aacb,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:40.918336 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d83cef81-b6fc-4b15-8127-f90d386d1d3d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:41.094941 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e320102-a32e-4d98-96b4-a726b36a2ec6 req-9d4a50aa-d542-4364-bb34-f44c047609de tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:41.094941 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3e320102-a32e-4d98-96b4-a726b36a2ec6 req-9d4a50aa-d542-4364-bb34-f44c047609de tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.0765631 Jun 17 10:59:41.135938 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3e320102-a32e-4d98-96b4-a726b36a2ec6 req-54c7f99e-e86b-498c-9a6d-3007c5d1873a tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0363271 Jun 17 10:59:41.145292 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59790) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:41.158617 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f2febd7c-6065-47af-8700-11c448a2e079 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:41.277264 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f2febd7c-6065-47af-8700-11c448a2e079 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:41.344577 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f2febd7c-6065-47af-8700-11c448a2e079 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:41.347561 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:41.399245 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2febd7c-6065-47af-8700-11c448a2e079 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ece748b-4541-4d22-adaa-83e28a339fd2,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:41.403870 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f2febd7c-6065-47af-8700-11c448a2e079 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:41.439982 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 59800) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:41.443638 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f2febd7c-6065-47af-8700-11c448a2e079 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=71eb1b40165c4423b07989840a7482ba&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2938404 Jun 17 10:59:41.540371 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-89952f45-fd8d-4b88-8589-3cddc3ab7ca1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:41.577128 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f056e0d4-9e6d-46e2-917d-406e29ead83a req-b74cfb3f-bd51-4ed6-a511-b84f7f43f964 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:41.578283 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f056e0d4-9e6d-46e2-917d-406e29ead83a req-b74cfb3f-bd51-4ed6-a511-b84f7f43f964 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 943 time: 0.1173697 Jun 17 10:59:41.585889 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-89952f45-fd8d-4b88-8589-3cddc3ab7ca1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:41.692297 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f056e0d4-9e6d-46e2-917d-406e29ead83a req-efdb64d5-0143-43a6-9898-29fd6940db5e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1039431 Jun 17 10:59:41.747052 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28e851a-da59-452f-b6e3-36db87659d32 req-72bffde3-154e-49a6-a5a2-ab75e272dd66 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:41.754639 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a28e851a-da59-452f-b6e3-36db87659d32 req-72bffde3-154e-49a6-a5a2-ab75e272dd66 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 943 time: 0.1387312 Jun 17 10:59:41.757452 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-89952f45-fd8d-4b88-8589-3cddc3ab7ca1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:41.760273 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-89952f45-fd8d-4b88-8589-3cddc3ab7ca1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:41.761427 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-89952f45-fd8d-4b88-8589-3cddc3ab7ca1 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/8ece748b-4541-4d22-adaa-83e28a339fd2 HTTP/1.1" status: 204 len: 168 time: 0.3192773 Jun 17 10:59:41.762463 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:41.783435 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89952f45-fd8d-4b88-8589-3cddc3ab7ca1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ece748b-4541-4d22-adaa-83e28a339fd2,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:41.787999 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-89952f45-fd8d-4b88-8589-3cddc3ab7ca1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:41.796714 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a28e851a-da59-452f-b6e3-36db87659d32 req-a662fc99-5470-4f9c-9566-8cfb99a90135 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410998 Jun 17 10:59:42.082634 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59824) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:42.097573 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-34d4133b-dd0b-4d95-8814-1e8f065e66dc admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:42.207794 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-34d4133b-dd0b-4d95-8814-1e8f065e66dc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:42.305454 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-34d4133b-dd0b-4d95-8814-1e8f065e66dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:42.309510 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3fe79b32-831a-43e0-8ff7-cfb60675aa47 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:42.326246 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-448aa728-aa1c-4bdb-a53f-46522b63830c req-d01ba651-3d6f-463b-8d2a-981f9cf5cb0d tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:42.327967 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-448aa728-aa1c-4bdb-a53f-46522b63830c req-d01ba651-3d6f-463b-8d2a-981f9cf5cb0d tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.0753760 Jun 17 10:59:42.353028 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-34d4133b-dd0b-4d95-8814-1e8f065e66dc admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=58b28905de8649c2a1ed5bac8acc74e0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2688997 Jun 17 10:59:42.354517 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 59842) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 10:59:42.361747 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d4133b-dd0b-4d95-8814-1e8f065e66dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e0b26dfc-8d26-482c-90a8-5767b5062e17,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:42.370012 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-34d4133b-dd0b-4d95-8814-1e8f065e66dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:42.390022 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-448aa728-aa1c-4bdb-a53f-46522b63830c req-e367e8ae-c120-4323-97bb-69515bbc5e54 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542016 Jun 17 10:59:42.420658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3438ae11-8c5d-4099-9e7a-036a124d0a3c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:42.441320 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3438ae11-8c5d-4099-9e7a-036a124d0a3c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:42.574166 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3438ae11-8c5d-4099-9e7a-036a124d0a3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:42.577369 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3438ae11-8c5d-4099-9e7a-036a124d0a3c admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:42.589806 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-3438ae11-8c5d-4099-9e7a-036a124d0a3c admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/e0b26dfc-8d26-482c-90a8-5767b5062e17 HTTP/1.1" status: 204 len: 168 time: 0.2234147 Jun 17 10:59:42.589806 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:42.589806 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3438ae11-8c5d-4099-9e7a-036a124d0a3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0b26dfc-8d26-482c-90a8-5767b5062e17,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:42.592719 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3438ae11-8c5d-4099-9e7a-036a124d0a3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:42.886723 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9c74621-5f34-44ba-befe-20978107020a req-3082c167-c019-4ce8-a469-593190551c1b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:42.893681 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f9c74621-5f34-44ba-befe-20978107020a req-3082c167-c019-4ce8-a469-593190551c1b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 943 time: 0.0824666 Jun 17 10:59:42.945653 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f9c74621-5f34-44ba-befe-20978107020a req-69b1e5fd-c4eb-445e-adff-eb9b1e4db990 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508776 Jun 17 10:59:43.072728 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ceb3ea-6881-423b-9419-8873921659b9 req-ecd80a0f-f89e-46ae-b23f-7cd885bf6934 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:43.074235 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b2ceb3ea-6881-423b-9419-8873921659b9 req-ecd80a0f-f89e-46ae-b23f-7cd885bf6934 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 943 time: 0.1061404 Jun 17 10:59:43.148931 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b2ceb3ea-6881-423b-9419-8873921659b9 req-2efcaaee-e1e7-423c-93eb-4efed6144592 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0633147 Jun 17 10:59:43.151577 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-79f935fb-868c-48a1-8756-64aa846f1f72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:43.153200 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-79f935fb-868c-48a1-8756-64aa846f1f72 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=54973ccd-0b2b-4517-ad28-76a3128a2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1316323 Jun 17 10:59:43.258183 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-4002ef3e-37fb-4b3d-a04a-b9cbf0d20770 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0946915 Jun 17 10:59:43.389778 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-932881f4-eb28-494b-8159-ef0f9e7fc0dc req-81b4f962-69d1-45cd-a85e-2a4f3cd0d73c service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1247253 Jun 17 10:59:43.624835 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e9e185-1141-4739-b707-31c73a4aca19 req-63cc6e1e-9bae-461b-bf56-e89cd102ab88 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:43.641067 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-56e9e185-1141-4739-b707-31c73a4aca19 req-63cc6e1e-9bae-461b-bf56-e89cd102ab88 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.1046736 Jun 17 10:59:43.655468 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a661e4-b44d-47b5-9fb3-7148106435c2 req-90dfab2c-2409-4a93-ad90-3c53ee502b31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:43.657206 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e5a661e4-b44d-47b5-9fb3-7148106435c2 req-90dfab2c-2409-4a93-ad90-3c53ee502b31 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 1096 time: 0.1452818 Jun 17 10:59:43.690914 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-56e9e185-1141-4739-b707-31c73a4aca19 req-2cbdff1b-3a83-4504-901a-1d9730ebeb12 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489678 Jun 17 10:59:44.010081 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a661e4-b44d-47b5-9fb3-7148106435c2 req-215e9098-64ec-4edf-9f62-2cb80be7239b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:44.011631 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e5a661e4-b44d-47b5-9fb3-7148106435c2 req-215e9098-64ec-4edf-9f62-2cb80be7239b service neutron] 10.222.0.25 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 911 time: 0.1978889 Jun 17 10:59:44.070267 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e5a661e4-b44d-47b5-9fb3-7148106435c2 req-0af9b4d0-eceb-4df4-aa0e-e7b49485a4d9 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=584d5dfc-3f46-4820-80b2-e729ce075654 HTTP/1.1" status: 200 len: 217 time: 0.0485618 Jun 17 10:59:44.154214 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a661e4-b44d-47b5-9fb3-7148106435c2 req-a027f522-a291-47bd-b614-f23aeaa3eda1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:44.155853 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e5a661e4-b44d-47b5-9fb3-7148106435c2 req-a027f522-a291-47bd-b614-f23aeaa3eda1 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 200 len: 849 time: 0.0788927 Jun 17 10:59:44.286692 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40b1d54b-10a2-4dff-9203-4cc604dac198 req-653ece46-ff93-47e3-a8af-de02cac3ba9a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:44.294821 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-40b1d54b-10a2-4dff-9203-4cc604dac198 req-653ece46-ff93-47e3-a8af-de02cac3ba9a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 943 time: 0.1728289 Jun 17 10:59:44.340365 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a661e4-b44d-47b5-9fb3-7148106435c2 req-d6f70672-8b78-4f78-bf36-1d5eb348f294 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:44.341839 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e5a661e4-b44d-47b5-9fb3-7148106435c2 req-d6f70672-8b78-4f78-bf36-1d5eb348f294 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=54973ccd-0b2b-4517-ad28-76a3128a2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1735947 Jun 17 10:59:44.411914 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-40b1d54b-10a2-4dff-9203-4cc604dac198 req-b152d3b4-2ea9-4ee2-adb7-da63be87134a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1160758 Jun 17 10:59:44.465322 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-028fadd2-68cf-4ad2-bf44-e338f7fae3d6 req-aca07f33-d7d9-4dd5-af12-8badeedd5591 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:44.467021 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-028fadd2-68cf-4ad2-bf44-e338f7fae3d6 req-aca07f33-d7d9-4dd5-af12-8badeedd5591 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 943 time: 0.1108053 Jun 17 10:59:44.513702 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-028fadd2-68cf-4ad2-bf44-e338f7fae3d6 req-7b9c1cb5-f762-4382-aff5-af1fa7f7818a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376344 Jun 17 10:59:44.525417 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e5a661e4-b44d-47b5-9fb3-7148106435c2 req-6ee269e7-ada0-429a-89a7-c9841e6e2ca6 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1719735 Jun 17 10:59:44.617794 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e5a661e4-b44d-47b5-9fb3-7148106435c2 req-4197e85e-8778-4ed4-a23f-c01c7d693ba4 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857587 Jun 17 10:59:44.886621 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7874d32f-7df3-4544-afb8-3237d5fd11bb req-aefb1831-dee1-4f06-b910-0a695bd26b54 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:44.888529 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7874d32f-7df3-4544-afb8-3237d5fd11bb req-aefb1831-dee1-4f06-b910-0a695bd26b54 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.0778892 Jun 17 10:59:44.933276 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7874d32f-7df3-4544-afb8-3237d5fd11bb req-e1454a2b-2419-4245-b683-3d573a9fc9c2 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390575 Jun 17 10:59:45.639753 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-346ad531-f088-4cf5-97d2-efb702e3f93f req-c16ced45-bc98-4d26-80df-39c6dbf7d845 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:45.641263 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-346ad531-f088-4cf5-97d2-efb702e3f93f req-c16ced45-bc98-4d26-80df-39c6dbf7d845 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 943 time: 0.0985341 Jun 17 10:59:45.691992 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-346ad531-f088-4cf5-97d2-efb702e3f93f req-b7bd11f7-e160-4079-8810-fa21c8b7e258 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429506 Jun 17 10:59:45.752821 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6634a8-2220-4359-81c1-6c3870e7f1cb req-340bfaa5-70a7-45e8-9eea-ad6d37500acd tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:45.761968 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-de6634a8-2220-4359-81c1-6c3870e7f1cb req-340bfaa5-70a7-45e8-9eea-ad6d37500acd tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 943 time: 0.1167064 Jun 17 10:59:45.813105 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-de6634a8-2220-4359-81c1-6c3870e7f1cb req-cb84030b-d319-4c15-b472-94dc1060dbd0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0500410 Jun 17 10:59:46.139774 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de5e61e1-a533-42c0-9184-52ce06fc5c0e req-0d950c26-4d1a-4b93-a9b0-0b60f3f85a90 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:46.141318 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-de5e61e1-a533-42c0-9184-52ce06fc5c0e req-0d950c26-4d1a-4b93-a9b0-0b60f3f85a90 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.0822358 Jun 17 10:59:46.185106 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-de5e61e1-a533-42c0-9184-52ce06fc5c0e req-eac80d66-4c44-4224-89da-9eb4e2121521 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0359433 Jun 17 10:59:46.908242 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a26dbd00-1056-4db4-8b93-9f8819cfff22 req-308e0e1b-2f2a-4087-9f2c-b827a713e22b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:46.909812 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a26dbd00-1056-4db4-8b93-9f8819cfff22 req-308e0e1b-2f2a-4087-9f2c-b827a713e22b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 943 time: 0.0748062 Jun 17 10:59:46.950700 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a26dbd00-1056-4db4-8b93-9f8819cfff22 req-37d43103-16e2-4dda-9826-9d1efbe0fea5 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335546 Jun 17 10:59:47.026922 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672db5e7-ab2f-4406-8fed-30c7cc246513 req-9779caa8-acfc-489b-b5f7-ef2d57ffbd88 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:47.028384 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-672db5e7-ab2f-4406-8fed-30c7cc246513 req-9779caa8-acfc-489b-b5f7-ef2d57ffbd88 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 943 time: 0.0757024 Jun 17 10:59:47.054376 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 10:59:47.071440 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-672db5e7-ab2f-4406-8fed-30c7cc246513 req-35f54088-1afa-462c-84d6-de8c50855c33 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0367780 Jun 17 10:59:47.375248 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c2dce0-3aa3-4777-b8fa-b40698a6493c req-6a6e4773-f0bc-424b-ba47-a5b3ee12c7be tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:47.376988 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-56c2dce0-3aa3-4777-b8fa-b40698a6493c req-6a6e4773-f0bc-424b-ba47-a5b3ee12c7be tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.0650089 Jun 17 10:59:47.414208 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-56c2dce0-3aa3-4777-b8fa-b40698a6493c req-a03b6820-d694-4ee6-b597-77ce123e866b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316041 Jun 17 10:59:47.949801 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 10:59:48.064514 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:48.077627 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '5df2bc70-d7c4-4355-b3d7-81d2732dfd9d', 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b', 'port_id': '5df2bc70-d7c4-4355-b3d7-81d2732dfd9d', 'mac_address': 'fa:16:3e:fe:97:30', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c10bc074-5591-4fbf-953f-e4097d48cc79', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 10:59:48.116116 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:48.129355 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 10:59:48.154883 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:48.171596 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd2b5fc-1943-4987-9162-dbfd59f98208 req-e463d953-8d17-43da-80ab-4bee3b752da5 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:48.172534 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4bd2b5fc-1943-4987-9162-dbfd59f98208 req-e463d953-8d17-43da-80ab-4bee3b752da5 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 943 time: 0.0901592 Jun 17 10:59:48.222976 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4bd2b5fc-1943-4987-9162-dbfd59f98208 req-b3592b32-fb69-4fae-847d-961d2ef369ea tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439017 Jun 17 10:59:48.225837 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:48.227759 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 584d5dfc-3f46-4820-80b2-e729ce075654 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 10:59:48.232302 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:48.267663 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1378b70a-e089-4539-af93-83dff13baa92 req-04d4073b-6e47-4635-a647-89fb4dfae444 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:48.271582 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1378b70a-e089-4539-af93-83dff13baa92 req-04d4073b-6e47-4635-a647-89fb4dfae444 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 943 time: 0.0648606 Jun 17 10:59:48.299974 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:48.306613 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:48.307360 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1378b70a-e089-4539-af93-83dff13baa92 req-acf2aef7-7078-4a7c-8f07-9e046c52e177 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317702 Jun 17 10:59:48.369214 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 584d5dfc-3f46-4820-80b2-e729ce075654, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=584d5dfc-3f46-4820-80b2-e729ce075654,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:48.381493 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '584d5dfc-3f46-4820-80b2-e729ce075654', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'port_id': '584d5dfc-3f46-4820-80b2-e729ce075654', 'mac_address': 'fa:16:3e:e1:22:7f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 126, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 10:59:48.527991 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:48.547456 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 584d5dfc-3f46-4820-80b2-e729ce075654 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 10:59:48.571294 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 584d5dfc-3f46-4820-80b2-e729ce075654, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=584d5dfc-3f46-4820-80b2-e729ce075654,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:48.611767 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b626a55-4db9-4058-8406-6db99ef05ad2 req-90431b9d-17b3-482b-ab60-b84c4b01d391 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:48.613721 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4b626a55-4db9-4058-8406-6db99ef05ad2 req-90431b9d-17b3-482b-ab60-b84c4b01d391 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 943 time: 0.0786517 Jun 17 10:59:48.637273 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:48.639393 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 879bb19b-66f7-48e8-83ce-097684433ad0 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 10:59:48.643821 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:48.655565 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4b626a55-4db9-4058-8406-6db99ef05ad2 req-830ac93c-a0b0-4159-9b1e-3881ad92363d tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350766 Jun 17 10:59:48.728649 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=584d5dfc-3f46-4820-80b2-e729ce075654,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:48.733626 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:48.802078 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 879bb19b-66f7-48e8-83ce-097684433ad0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=879bb19b-66f7-48e8-83ce-097684433ad0,segment=NetworkSegment(12145aeb-cad3-4041-a8a6-2c52a27c3eb7),segment_id=12145aeb-cad3-4041-a8a6-2c52a27c3eb7)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:48.814274 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '879bb19b-66f7-48e8-83ce-097684433ad0', 'network_id': 'e30545f7-6269-420b-a870-c56fe4fa7478', 'port_id': '879bb19b-66f7-48e8-83ce-097684433ad0', 'mac_address': 'fa:16:3e:e3:8b:5f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 143, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '556ccdca-d712-410a-a954-c43564443811', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 10:59:48.858372 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:48.873113 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 879bb19b-66f7-48e8-83ce-097684433ad0 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 10:59:48.896926 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 879bb19b-66f7-48e8-83ce-097684433ad0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=879bb19b-66f7-48e8-83ce-097684433ad0,segment=NetworkSegment(12145aeb-cad3-4041-a8a6-2c52a27c3eb7),segment_id=12145aeb-cad3-4041-a8a6-2c52a27c3eb7)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:48.978022 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:48.978022 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-a0610cf5-90d1-477b-9bc3-21b83dab553f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:49.034664 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=879bb19b-66f7-48e8-83ce-097684433ad0,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:49.039916 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:49.396776 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85734f95-cbb8-436b-935a-f9ae98972794 req-5e5e01ba-0b0e-4839-83cf-9ea199ab87ce tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:49.398227 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-85734f95-cbb8-436b-935a-f9ae98972794 req-5e5e01ba-0b0e-4839-83cf-9ea199ab87ce tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 944 time: 0.0625887 Jun 17 10:59:49.436388 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-85734f95-cbb8-436b-935a-f9ae98972794 req-0b127521-552e-47e5-a921-08c7d3e8e84e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313213 Jun 17 10:59:49.496122 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70bf736d-e166-42ca-b8ae-9b14a380f638 req-ffe4d940-c0ed-42f4-beea-4365bd53b53c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:49.497484 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-70bf736d-e166-42ca-b8ae-9b14a380f638 req-ffe4d940-c0ed-42f4-beea-4365bd53b53c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 944 time: 0.0675282 Jun 17 10:59:49.533859 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-70bf736d-e166-42ca-b8ae-9b14a380f638 req-c311354b-7047-461b-a73c-c622808f8c58 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306253 Jun 17 10:59:49.837635 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-326c7579-2245-4da8-8acf-67fe3066f6bd req-1331a670-d9f9-48e8-b794-15855082795b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:49.839132 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-326c7579-2245-4da8-8acf-67fe3066f6bd req-1331a670-d9f9-48e8-b794-15855082795b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 944 time: 0.0645008 Jun 17 10:59:49.877442 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-326c7579-2245-4da8-8acf-67fe3066f6bd req-2dd1e450-e294-42fd-83de-27473af2758e tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318842 Jun 17 10:59:50.602014 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-4389c132-ca1c-4e0a-8b30-9b625a6a8edd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:50.612754 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7997589b-5f34-47e7-9042-3b6f16a33f01 req-6d248035-a69d-43d7-a186-de1c8a70cfdd tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:50.614021 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7997589b-5f34-47e7-9042-3b6f16a33f01 req-6d248035-a69d-43d7-a186-de1c8a70cfdd tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 944 time: 0.0629580 Jun 17 10:59:50.653576 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7997589b-5f34-47e7-9042-3b6f16a33f01 req-5630afb9-0259-4189-8299-5075f98a5bdf tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332708 Jun 17 10:59:50.710046 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561c3c64-2192-4f2a-b810-f24d3ae6fde5 req-ab55bc3a-9307-4d28-9f2e-df9085c8772e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:50.711545 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-561c3c64-2192-4f2a-b810-f24d3ae6fde5 req-ab55bc3a-9307-4d28-9f2e-df9085c8772e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 944 time: 0.0625260 Jun 17 10:59:50.747692 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-561c3c64-2192-4f2a-b810-f24d3ae6fde5 req-6ed3180d-812f-4d99-9e9f-604d9d7e83af tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0305817 Jun 17 10:59:51.049019 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bee0e20-1b0d-4d3f-b9c0-7570ae44d288 req-c62a97b3-7ea6-40c9-b011-438e482534b2 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:51.050374 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8bee0e20-1b0d-4d3f-b9c0-7570ae44d288 req-c62a97b3-7ea6-40c9-b011-438e482534b2 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 944 time: 0.0651414 Jun 17 10:59:51.088543 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8bee0e20-1b0d-4d3f-b9c0-7570ae44d288 req-f41b4933-a7b0-4205-80cd-f5eef304f476 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319505 Jun 17 10:59:51.835634 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af5b708-28fa-4951-827f-b8ae3cc9d478 req-d4d0467d-e4d6-4707-8bd0-f194c885cb1c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:51.837188 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0af5b708-28fa-4951-827f-b8ae3cc9d478 req-d4d0467d-e4d6-4707-8bd0-f194c885cb1c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 944 time: 0.0722768 Jun 17 10:59:51.876406 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0af5b708-28fa-4951-827f-b8ae3cc9d478 req-dcb9855a-67d5-4ad4-8711-51c57f8c3753 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332758 Jun 17 10:59:51.924872 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4005a2f5-f0fd-4ed0-a709-cc040b10ed05 req-293ac598-f210-4113-8267-72ea836b2255 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:51.926714 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4005a2f5-f0fd-4ed0-a709-cc040b10ed05 req-293ac598-f210-4113-8267-72ea836b2255 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 944 time: 0.0673599 Jun 17 10:59:51.968689 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4005a2f5-f0fd-4ed0-a709-cc040b10ed05 req-fba29665-84bd-4ddf-8bb0-6c0d7057381f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0362535 Jun 17 10:59:52.257671 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1bc11b9-8709-4ec3-8407-16e4a332bf8c req-ed2007d6-0136-4588-90ec-4aeee1e184c8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:52.259499 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e1bc11b9-8709-4ec3-8407-16e4a332bf8c req-ed2007d6-0136-4588-90ec-4aeee1e184c8 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 944 time: 0.0614777 Jun 17 10:59:52.295710 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e1bc11b9-8709-4ec3-8407-16e4a332bf8c req-996ffc02-a2a7-42cb-85b2-ee70b16c7751 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0305398 Jun 17 10:59:52.460856 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5df2bc70-d7c4-4355-b3d7-81d2732dfd9d'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 10:59:52.503879 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['879bb19b-66f7-48e8-83ce-097684433ad0'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 10:59:52.566758 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['584d5dfc-3f46-4820-80b2-e729ce075654'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 10:59:53.058928 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e473b322-4766-43f1-8eae-b3b6d463fb9a req-f5078565-aacf-43e8-8b01-4f0c66033243 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:53.060935 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e473b322-4766-43f1-8eae-b3b6d463fb9a req-f5078565-aacf-43e8-8b01-4f0c66033243 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 944 time: 0.0673292 Jun 17 10:59:53.116339 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e473b322-4766-43f1-8eae-b3b6d463fb9a req-8ee8e98d-f004-4f36-b4ae-4140720a2b59 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475745 Jun 17 10:59:53.152576 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88ce899-5b5d-44eb-9f7e-f437b80d9ebe req-172f8ff5-acce-4a1b-b81f-8d4acd05fbe0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:53.154021 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e88ce899-5b5d-44eb-9f7e-f437b80d9ebe req-172f8ff5-acce-4a1b-b81f-8d4acd05fbe0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 944 time: 0.0670846 Jun 17 10:59:53.197139 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e88ce899-5b5d-44eb-9f7e-f437b80d9ebe req-830fdd7e-fff2-4cab-80aa-8b48b892fd24 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371706 Jun 17 10:59:53.379516 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-fc2c8ec7-b811-42f1-b97d-460a261b39fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:53.501389 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7894d4b-dcf3-4b74-952d-f1f6eb5cd07f req-68d764ab-d5a0-43de-8b3c-e1f941a66b7e tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:53.501389 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d7894d4b-dcf3-4b74-952d-f1f6eb5cd07f req-68d764ab-d5a0-43de-8b3c-e1f941a66b7e tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 944 time: 0.0898855 Jun 17 10:59:53.537362 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d7894d4b-dcf3-4b74-952d-f1f6eb5cd07f req-f2f585f4-d0fc-4881-8c7c-1a1848e4132b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323482 Jun 17 10:59:53.624469 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:54.311564 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465f3695-d978-43cd-9764-546b773dafa0 req-ca231639-58f5-412a-b1db-4bb899c3c1de tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:54.313861 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-465f3695-d978-43cd-9764-546b773dafa0 req-ca231639-58f5-412a-b1db-4bb899c3c1de tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 944 time: 0.0890329 Jun 17 10:59:54.362195 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-465f3695-d978-43cd-9764-546b773dafa0 req-bc1175c6-d2fd-419c-89da-d7391a2e53b9 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381157 Jun 17 10:59:54.404147 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97a21a6a-989e-40f2-8084-eb46910256f3 req-898c240e-a258-4688-834d-a9ed019af824 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:54.405742 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-97a21a6a-989e-40f2-8084-eb46910256f3 req-898c240e-a258-4688-834d-a9ed019af824 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 944 time: 0.0721383 Jun 17 10:59:54.412681 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:54.449423 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-97a21a6a-989e-40f2-8084-eb46910256f3 req-6bf76aad-2349-4ca9-ac8c-af33b1934483 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373142 Jun 17 10:59:54.711703 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a64f518-0bde-4f4e-a967-892fe8f56b45 req-7aee2666-d637-4e06-9aa1-e44e785004b4 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:54.713046 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9a64f518-0bde-4f4e-a967-892fe8f56b45 req-7aee2666-d637-4e06-9aa1-e44e785004b4 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 944 time: 0.0607319 Jun 17 10:59:54.750098 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9a64f518-0bde-4f4e-a967-892fe8f56b45 req-58b9d641-5638-4526-99c8-02af75b5d157 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314722 Jun 17 10:59:55.526475 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 879bb19b-66f7-48e8-83ce-097684433ad0 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:59:55.599419 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5c5978-20d1-4430-9dcb-eed8041ad656 req-9759a279-633d-4763-ba9e-7f58c99ce67a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:55.602401 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ca5c5978-20d1-4430-9dcb-eed8041ad656 req-9759a279-633d-4763-ba9e-7f58c99ce67a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 944 time: 0.1282361 Jun 17 10:59:55.647413 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ca5c5978-20d1-4430-9dcb-eed8041ad656 req-110c1da0-3c54-4fa1-90d4-6a3776af41fe tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0356412 Jun 17 10:59:55.666037 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbc5f103-37d1-4973-938d-c5ad608010c3 req-9736d2a4-56be-4f34-b13b-9af8385739b9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:55.667908 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-cbc5f103-37d1-4973-938d-c5ad608010c3 req-9736d2a4-56be-4f34-b13b-9af8385739b9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 944 time: 0.0797327 Jun 17 10:59:55.687089 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 879bb19b-66f7-48e8-83ce-097684433ad0 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:59:55.691285 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 879bb19b-66f7-48e8-83ce-097684433ad0 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:55.691665 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:55.710996 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-cbc5f103-37d1-4973-938d-c5ad608010c3 req-fcf1bf0f-c919-4e3e-a344-5a1ce8f943bf tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371144 Jun 17 10:59:55.766732 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:55.791572 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf72262e-dfa5-4b03-b340-7b31fd5ecec6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '879bb19b-66f7-48e8-83ce-097684433ad0'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 10:59:55.867458 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 879bb19b-66f7-48e8-83ce-097684433ad0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=879bb19b-66f7-48e8-83ce-097684433ad0,segment=NetworkSegment(12145aeb-cad3-4041-a8a6-2c52a27c3eb7),segment_id=12145aeb-cad3-4041-a8a6-2c52a27c3eb7)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:55.927123 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dacc5a0-5373-4b5d-8340-2dba7f7c0fcb req-a38461e1-fcb7-443a-83bb-d2081683cb1b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:55.927619 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:55.929645 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0dacc5a0-5373-4b5d-8340-2dba7f7c0fcb req-a38461e1-fcb7-443a-83bb-d2081683cb1b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 944 time: 0.0679729 Jun 17 10:59:55.929863 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:55.972930 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0dacc5a0-5373-4b5d-8340-2dba7f7c0fcb req-ec53269f-1eab-412d-9f98-dd338f709f30 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354314 Jun 17 10:59:55.981171 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3617d05-f59c-4ce1-966a-584dba2c7705" -d '{"events": [{"server_uuid": "cf72262e-dfa5-4b03-b340-7b31fd5ecec6", "name": "network-vif-plugged", "status": "completed", "tag": "879bb19b-66f7-48e8-83ce-097684433ad0"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 10:59:55.995875 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=879bb19b-66f7-48e8-83ce-097684433ad0,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:55.999214 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:56.075376 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 10:59:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7550690a-bb1e-48b3-878a-6a5a5e8d98ea x-openstack-request-id: req-7550690a-bb1e-48b3-878a-6a5a5e8d98ea {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 10:59:56.075749 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf72262e-dfa5-4b03-b340-7b31fd5ecec6", "name": "network-vif-plugged", "status": "completed", "tag": "879bb19b-66f7-48e8-83ce-097684433ad0", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 10:59:56.076069 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-7550690a-bb1e-48b3-878a-6a5a5e8d98ea {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 10:59:56.076629 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf72262e-dfa5-4b03-b340-7b31fd5ecec6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '879bb19b-66f7-48e8-83ce-097684433ad0', 'code': 200} Jun 17 10:59:56.482468 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:59:56.624990 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:59:56.629539 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:56.630483 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:56.721479 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:56.755105 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:56.773418 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:56.830667 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:56.831567 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 584d5dfc-3f46-4820-80b2-e729ce075654 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 10:59:56.833507 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:56.840513 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53aa9e46-9b91-421a-8330-b033836ffd33 req-5dbe6f5d-9797-4434-a28a-9003399035fc tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:56.840513 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-53aa9e46-9b91-421a-8330-b033836ffd33 req-5dbe6f5d-9797-4434-a28a-9003399035fc tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 944 time: 0.0637560 Jun 17 10:59:56.882523 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-53aa9e46-9b91-421a-8330-b033836ffd33 req-4ec5eedf-c9d5-47fe-aad9-ffc2d608fa2b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362356 Jun 17 10:59:56.898840 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4bf197-539b-4611-adbd-5c1c27e50aa5 req-c1fa97a2-29b8-4639-8589-32baf942f6f9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:56.908244 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9a4bf197-539b-4611-adbd-5c1c27e50aa5 req-c1fa97a2-29b8-4639-8589-32baf942f6f9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 944 time: 0.0671389 Jun 17 10:59:56.908547 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:56.910479 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:56.941335 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9a4bf197-539b-4611-adbd-5c1c27e50aa5 req-eb78f910-395c-4640-b837-a7f5d552ec63 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325565 Jun 17 10:59:56.979053 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 584d5dfc-3f46-4820-80b2-e729ce075654 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 10:59:56.982990 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 584d5dfc-3f46-4820-80b2-e729ce075654 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 10:59:56.983372 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:57.060844 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:57.093921 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 584d5dfc-3f46-4820-80b2-e729ce075654, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=584d5dfc-3f46-4820-80b2-e729ce075654,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 10:59:57.141910 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48294f95-e1db-4043-b2b4-2ae2553e20a6 req-70f8bba7-1496-4cf7-b0bb-fd1209662fbe tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:57.143380 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-48294f95-e1db-4043-b2b4-2ae2553e20a6 req-70f8bba7-1496-4cf7-b0bb-fd1209662fbe tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0611479 Jun 17 10:59:57.183816 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-48294f95-e1db-4043-b2b4-2ae2553e20a6 req-61b1b058-99ac-4c5d-9721-79aef0b63091 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319898 Jun 17 10:59:57.185097 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:57.187857 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-5bc640d6-519f-47dc-b8b1-c86ac1a631ea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:57.235523 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=584d5dfc-3f46-4820-80b2-e729ce075654,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:57.238657 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:58.068925 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-208f44e4-f0ca-4274-98d4-4bf45525b06a req-09d8918e-5540-4f14-95b1-8e319086dc22 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:58.070323 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-208f44e4-f0ca-4274-98d4-4bf45525b06a req-09d8918e-5540-4f14-95b1-8e319086dc22 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0633736 Jun 17 10:59:58.078063 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e6129b0-030d-4abe-90f0-dea76231bc08', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5df2bc70-d7c4-4355-b3d7-81d2732dfd9d'}, {'server_uuid': '0878d13b-20f2-49ea-8fe7-94094628f250', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '584d5dfc-3f46-4820-80b2-e729ce075654'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 10:59:58.079631 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-627b84d8-f590-4db2-ba08-032391ba12ac" -d '{"events": [{"server_uuid": "6e6129b0-030d-4abe-90f0-dea76231bc08", "name": "network-vif-plugged", "status": "completed", "tag": "5df2bc70-d7c4-4355-b3d7-81d2732dfd9d"}, {"server_uuid": "0878d13b-20f2-49ea-8fe7-94094628f250", "name": "network-vif-plugged", "status": "completed", "tag": "584d5dfc-3f46-4820-80b2-e729ce075654"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 10:59:58.110507 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-208f44e4-f0ca-4274-98d4-4bf45525b06a req-659fd597-f4ad-4220-adf9-bac6f738a0c7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340810 Jun 17 10:59:58.115358 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cb96c41-1069-4117-b500-1ab3046dc7ca req-ea7c122f-643e-46c3-861f-b904dac63f2b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:58.116860 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7cb96c41-1069-4117-b500-1ab3046dc7ca req-ea7c122f-643e-46c3-861f-b904dac63f2b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0656908 Jun 17 10:59:58.155246 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7cb96c41-1069-4117-b500-1ab3046dc7ca req-b96b8df9-f4e7-4d54-9d89-76d23045fdad tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318890 Jun 17 10:59:58.163122 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 17 Jun 2021 10:59:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d1e40471-e394-417b-b794-82df7d974a3c x-openstack-request-id: req-d1e40471-e394-417b-b794-82df7d974a3c {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 10:59:58.163420 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6e6129b0-030d-4abe-90f0-dea76231bc08", "name": "network-vif-plugged", "status": "completed", "tag": "5df2bc70-d7c4-4355-b3d7-81d2732dfd9d", "code": 200}, {"server_uuid": "0878d13b-20f2-49ea-8fe7-94094628f250", "name": "network-vif-plugged", "status": "completed", "tag": "584d5dfc-3f46-4820-80b2-e729ce075654", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 10:59:58.163673 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-d1e40471-e394-417b-b794-82df7d974a3c {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 10:59:58.164066 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6e6129b0-030d-4abe-90f0-dea76231bc08', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5df2bc70-d7c4-4355-b3d7-81d2732dfd9d', 'code': 200} Jun 17 10:59:58.164485 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0878d13b-20f2-49ea-8fe7-94094628f250', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '584d5dfc-3f46-4820-80b2-e729ce075654', 'code': 200} Jun 17 10:59:58.342485 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-874dd1e1-69a0-409b-9c21-2337a1af12b8 req-3fa15492-ba23-4ed9-8f86-fc47a1599a86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:58.343973 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-874dd1e1-69a0-409b-9c21-2337a1af12b8 req-3fa15492-ba23-4ed9-8f86-fc47a1599a86 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 1098 time: 0.1146491 Jun 17 10:59:58.368447 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-874dd1e1-69a0-409b-9c21-2337a1af12b8 req-fd89288c-6377-41af-9b83-0bcb85b6c4c7 service neutron] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:58.408960 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d26f36-07d5-47f0-87e9-3f9665a1fa2f req-da29a430-8c17-46fe-96d0-3fbcc279220a tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:58.410431 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f8d26f36-07d5-47f0-87e9-3f9665a1fa2f req-da29a430-8c17-46fe-96d0-3fbcc279220a tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.1061211 Jun 17 10:59:58.463589 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f8d26f36-07d5-47f0-87e9-3f9665a1fa2f req-175a4780-a5d9-411e-b503-e87bd5f6f517 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472937 Jun 17 10:59:58.513311 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-874dd1e1-69a0-409b-9c21-2337a1af12b8 req-fd89288c-6377-41af-9b83-0bcb85b6c4c7 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:58.590131 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-874dd1e1-69a0-409b-9c21-2337a1af12b8 req-fd89288c-6377-41af-9b83-0bcb85b6c4c7 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 10:59:58.592422 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0df87529-b305-4eac-bec0-40610210366d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 10:59:58.627529 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-874dd1e1-69a0-409b-9c21-2337a1af12b8 req-fd89288c-6377-41af-9b83-0bcb85b6c4c7 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2709000 Jun 17 10:59:58.627529 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd89288c-6377-41af-9b83-0bcb85b6c4c7 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=404efd93-9b32-4afd-bff5-4e911b1fa30f,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 10:59:58.631239 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fd89288c-6377-41af-9b83-0bcb85b6c4c7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 10:59:58.878260 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c773e36d-dc91-4fa6-b344-6b59cc0cd3ff req-f8637f67-4d3d-462f-870d-785a10ea7af6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:58.879752 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c773e36d-dc91-4fa6-b344-6b59cc0cd3ff req-f8637f67-4d3d-462f-870d-785a10ea7af6 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 1098 time: 0.0533366 Jun 17 10:59:58.913243 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c773e36d-dc91-4fa6-b344-6b59cc0cd3ff req-8409d0fb-5900-4426-9212-a997c245c66d service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0270076 Jun 17 10:59:58.924753 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863184b4-804d-4b4c-b622-48f4772ee9b6 req-ba612e9a-d2c2-44c2-9e4c-dddbd50afd43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:58.926249 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-863184b4-804d-4b4c-b622-48f4772ee9b6 req-ba612e9a-d2c2-44c2-9e4c-dddbd50afd43 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 1098 time: 0.0889215 Jun 17 10:59:59.284910 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15118277-9ea3-426c-bd48-1f25eb98a8a0 req-405f682c-851f-482a-9afb-f5f3452a510d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:59.286927 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-15118277-9ea3-426c-bd48-1f25eb98a8a0 req-405f682c-851f-482a-9afb-f5f3452a510d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0625193 Jun 17 10:59:59.324800 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-15118277-9ea3-426c-bd48-1f25eb98a8a0 req-f22d411c-ca81-490b-91ca-3ec0c80c9609 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319703 Jun 17 10:59:59.503351 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a4bfe5-80fd-424a-bf45-32d11805f4c2 req-b7a981f8-3b4c-4b55-9c35-53bcc5d72685 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:59.504840 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d3a4bfe5-80fd-424a-bf45-32d11805f4c2 req-b7a981f8-3b4c-4b55-9c35-53bcc5d72685 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.2253506 Jun 17 10:59:59.541762 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d3a4bfe5-80fd-424a-bf45-32d11805f4c2 req-e68db6c5-69d2-4d36-b9f8-82038fe342cd tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313172 Jun 17 10:59:59.654823 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b76d9f3-89e1-4895-af00-a95e0cf717fe req-a4203542-659c-428e-847f-850c1af95bfb tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 10:59:59.656294 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9b76d9f3-89e1-4895-af00-a95e0cf717fe req-a4203542-659c-428e-847f-850c1af95bfb tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0773416 Jun 17 10:59:59.694742 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9b76d9f3-89e1-4895-af00-a95e0cf717fe req-7c078533-77e7-4130-bc2d-5e5896cea238 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321572 Jun 17 11:00:00.494494 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d23fc587-15fb-4247-948e-09dfff689bb0 req-484c9715-9983-4b0c-b240-0d85e4027a7d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:00.495948 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d23fc587-15fb-4247-948e-09dfff689bb0 req-484c9715-9983-4b0c-b240-0d85e4027a7d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0599961 Jun 17 11:00:00.532857 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d23fc587-15fb-4247-948e-09dfff689bb0 req-90221826-c2e5-4627-bcb4-946067bd390e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309463 Jun 17 11:00:00.709846 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8877a55-2a32-4cc9-9121-095309949aaf req-6794ad1a-a301-4289-9f00-ba6846b3a430 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:00.711313 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d8877a55-2a32-4cc9-9121-095309949aaf req-6794ad1a-a301-4289-9f00-ba6846b3a430 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0620909 Jun 17 11:00:00.747225 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d8877a55-2a32-4cc9-9121-095309949aaf req-d6ab8453-dd4b-467e-9966-fc862911c347 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303056 Jun 17 11:00:00.871232 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9c4244-761d-41cd-bc1a-b3fe98b5d281 req-44f1e1c4-3024-4e6a-a66e-4cdf543523d0 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:00.872591 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3a9c4244-761d-41cd-bc1a-b3fe98b5d281 req-44f1e1c4-3024-4e6a-a66e-4cdf543523d0 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0637686 Jun 17 11:00:00.909859 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3a9c4244-761d-41cd-bc1a-b3fe98b5d281 req-d79bb2c3-c291-440b-afdd-2e1551fb0c0c tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313787 Jun 17 11:00:01.700272 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b124149c-9562-4ec3-a860-e29d34898709 req-0374723e-b8d6-4480-892f-eabb3356a78f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:01.701710 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b124149c-9562-4ec3-a860-e29d34898709 req-0374723e-b8d6-4480-892f-eabb3356a78f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0625775 Jun 17 11:00:01.741356 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b124149c-9562-4ec3-a860-e29d34898709 req-43ba933d-f333-44f5-8dbb-edb88708c24a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340533 Jun 17 11:00:01.849386 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-863184b4-804d-4b4c-b622-48f4772ee9b6 req-2997ec3b-9d57-42db-b611-263a1939a251 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422187 Jun 17 11:00:01.924996 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c1e1e2d-b11d-476c-9e60-bf240474370a req-80be715f-a6dc-4843-aa85-0454e90c6ceb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:01.926448 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0c1e1e2d-b11d-476c-9e60-bf240474370a req-80be715f-a6dc-4843-aa85-0454e90c6ceb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0610931 Jun 17 11:00:01.967560 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0c1e1e2d-b11d-476c-9e60-bf240474370a req-aff4f6d0-81ae-4d96-8ccd-91d2741df079 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0337358 Jun 17 11:00:02.087963 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d28cef57-4d1b-4e15-b1dd-27ab133e8ec5 req-55b23e59-21d2-49bd-953b-d7f1b0f0b4bc tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:02.089329 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d28cef57-4d1b-4e15-b1dd-27ab133e8ec5 req-55b23e59-21d2-49bd-953b-d7f1b0f0b4bc tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0612321 Jun 17 11:00:02.125411 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d28cef57-4d1b-4e15-b1dd-27ab133e8ec5 req-ad1e71e2-2f91-43e4-9007-720d3e649eff tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302393 Jun 17 11:00:02.907956 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02eb1c1a-07af-4614-8b47-e54a379fa84e req-d2e13734-75b5-4816-9bae-f061e1803648 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:02.909389 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-02eb1c1a-07af-4614-8b47-e54a379fa84e req-d2e13734-75b5-4816-9bae-f061e1803648 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0600820 Jun 17 11:00:02.947307 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-02eb1c1a-07af-4614-8b47-e54a379fa84e req-1f497634-6109-4b8a-a04d-5b816e76ef97 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314634 Jun 17 11:00:03.134189 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9689ed0f-bdc9-4cfa-9b1b-49812f4f4e33 req-c72bc40e-4efe-4264-8e75-68c9c16dd17a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:03.135669 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9689ed0f-bdc9-4cfa-9b1b-49812f4f4e33 req-c72bc40e-4efe-4264-8e75-68c9c16dd17a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0612168 Jun 17 11:00:03.176931 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9689ed0f-bdc9-4cfa-9b1b-49812f4f4e33 req-8ea879da-c396-4526-aa77-f0e0bf5ea438 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0357339 Jun 17 11:00:03.297346 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976767e0-cca6-471f-8a93-c9b1b215a8a2 req-09524f0d-96d6-4096-bce4-a0f31c4a3323 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:03.298803 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-976767e0-cca6-471f-8a93-c9b1b215a8a2 req-09524f0d-96d6-4096-bce4-a0f31c4a3323 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0630667 Jun 17 11:00:03.334210 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-976767e0-cca6-471f-8a93-c9b1b215a8a2 req-08ead1c1-5c8d-4126-bd43-e7ee1fd359b2 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0298920 Jun 17 11:00:04.114355 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f089c099-82bf-40d3-99e0-d878e0f921ea req-3f8780ea-b323-4b8c-851c-fa6b6407fea1 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:04.115939 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f089c099-82bf-40d3-99e0-d878e0f921ea req-3f8780ea-b323-4b8c-851c-fa6b6407fea1 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0610693 Jun 17 11:00:04.153678 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f089c099-82bf-40d3-99e0-d878e0f921ea req-fd5c54cd-8cfc-4c80-8e81-1878fbfa3b0d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322728 Jun 17 11:00:04.347419 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34aa6c65-5ed9-4dab-8b9e-6abebff0c055 req-910b2dd0-1d0e-4646-81b5-8399e6f2879c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:04.349400 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-34aa6c65-5ed9-4dab-8b9e-6abebff0c055 req-910b2dd0-1d0e-4646-81b5-8399e6f2879c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0618575 Jun 17 11:00:04.387042 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-34aa6c65-5ed9-4dab-8b9e-6abebff0c055 req-158c3102-7fd7-4f52-b670-45ed223adbcf tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320580 Jun 17 11:00:04.429004 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:04.508908 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e0fa0d6-7c9b-4c79-980a-5de2ae8348dd req-d0337fe0-e640-4c25-b70d-67c04eba23ce tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:04.510232 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2e0fa0d6-7c9b-4c79-980a-5de2ae8348dd req-d0337fe0-e640-4c25-b70d-67c04eba23ce tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0609066 Jun 17 11:00:04.546758 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2e0fa0d6-7c9b-4c79-980a-5de2ae8348dd req-e71485b9-b202-48f4-a1b6-1552d626aa26 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309114 Jun 17 11:00:05.326373 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f8fae57-8bf5-43f1-9bc6-ef8c34ad3f29 req-0fa29375-5f27-44e7-9b8e-9fe438f5d6a4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:05.327841 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6f8fae57-8bf5-43f1-9bc6-ef8c34ad3f29 req-0fa29375-5f27-44e7-9b8e-9fe438f5d6a4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0637906 Jun 17 11:00:05.365508 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6f8fae57-8bf5-43f1-9bc6-ef8c34ad3f29 req-a8d99490-aaa7-4832-829a-832f36b0a19d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317552 Jun 17 11:00:05.559946 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b461d1-b6b0-4281-b456-73deb8b9bd65 req-5b3a8bad-c9de-4b99-89b8-820adeba6260 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:05.561298 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e1b461d1-b6b0-4281-b456-73deb8b9bd65 req-5b3a8bad-c9de-4b99-89b8-820adeba6260 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0640402 Jun 17 11:00:05.597964 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e1b461d1-b6b0-4281-b456-73deb8b9bd65 req-97828f1e-2f0d-40a0-8bd4-ee4b43349211 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311508 Jun 17 11:00:05.713587 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3120c965-d37a-4657-aa5d-41fdd4415824 req-e7804c79-64f2-4bc3-a692-0522cd0691bc tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:05.715063 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3120c965-d37a-4657-aa5d-41fdd4415824 req-e7804c79-64f2-4bc3-a692-0522cd0691bc tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0607564 Jun 17 11:00:05.751817 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3120c965-d37a-4657-aa5d-41fdd4415824 req-bc3411dc-c9b6-4d3e-96ca-cbe9d6034228 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312426 Jun 17 11:00:06.534295 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a2cde4-e332-46d5-b13e-239d0358aa5f req-7fdc07e4-0419-4a1a-93b8-e307b144e0d9 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:06.535789 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-45a2cde4-e332-46d5-b13e-239d0358aa5f req-7fdc07e4-0419-4a1a-93b8-e307b144e0d9 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0612743 Jun 17 11:00:06.571527 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-45a2cde4-e332-46d5-b13e-239d0358aa5f req-1a706693-7f87-415e-8ed5-b2b63e2a75a9 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302987 Jun 17 11:00:06.768210 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17071940-bc26-45c8-9ef9-43a8e03b55d6 req-299e9edf-116b-4bde-bc98-b2292685deea tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:06.769777 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-17071940-bc26-45c8-9ef9-43a8e03b55d6 req-299e9edf-116b-4bde-bc98-b2292685deea tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0641427 Jun 17 11:00:06.811720 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-17071940-bc26-45c8-9ef9-43a8e03b55d6 req-80604b38-bc32-4a90-85b9-14f7d4de2a80 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0336256 Jun 17 11:00:06.923234 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4057062-95cf-4ba2-9616-24f25caab2da req-c0ae8fbb-9272-4198-80f2-32b2333ab02f tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:06.924643 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d4057062-95cf-4ba2-9616-24f25caab2da req-c0ae8fbb-9272-4198-80f2-32b2333ab02f tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0630977 Jun 17 11:00:06.960788 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d4057062-95cf-4ba2-9616-24f25caab2da req-696bb10f-8c17-4548-ac1c-c1136f1b95f4 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0300391 Jun 17 11:00:07.744438 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bc5dc61-79f3-4054-aafb-adafab877d6a req-c113b7ad-ca01-4dbd-b32b-037c3294bb08 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:07.745866 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3bc5dc61-79f3-4054-aafb-adafab877d6a req-c113b7ad-ca01-4dbd-b32b-037c3294bb08 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0642936 Jun 17 11:00:07.782284 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3bc5dc61-79f3-4054-aafb-adafab877d6a req-41fc15a7-4acc-4f3e-845a-1a3149fb9b53 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0305517 Jun 17 11:00:07.978301 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079aceec-3ef7-4bd8-8f5f-850f5cf21574 req-2277cf5c-74b9-46d9-91e6-7331bfb0c259 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:07.980057 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-079aceec-3ef7-4bd8-8f5f-850f5cf21574 req-2277cf5c-74b9-46d9-91e6-7331bfb0c259 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0601728 Jun 17 11:00:08.017271 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-079aceec-3ef7-4bd8-8f5f-850f5cf21574 req-7b58e381-b651-4af2-b00b-eb5e6c089070 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316682 Jun 17 11:00:08.127098 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cad7ebc5-3611-4ed3-bbf0-bb9f2bea0531 req-b949de9f-186d-4d6d-b7e1-bca4124f92e0 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:08.128592 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-cad7ebc5-3611-4ed3-bbf0-bb9f2bea0531 req-b949de9f-186d-4d6d-b7e1-bca4124f92e0 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0616977 Jun 17 11:00:08.167301 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-cad7ebc5-3611-4ed3-bbf0-bb9f2bea0531 req-e1d6d1df-d96b-442e-890a-2cb87d520730 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326405 Jun 17 11:00:09.093502 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a477f01-d7f5-468d-a317-b2e7c49a6e06 req-42d72ca9-7312-46bc-9c14-d838373f4fa4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:09.094982 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7a477f01-d7f5-468d-a317-b2e7c49a6e06 req-42d72ca9-7312-46bc-9c14-d838373f4fa4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0665386 Jun 17 11:00:09.132800 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7a477f01-d7f5-468d-a317-b2e7c49a6e06 req-c3dc339a-45f9-4ce2-8e50-cc0e68eab981 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312486 Jun 17 11:00:09.189920 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f13f5e-a47d-4cbb-bbd9-ad606434dc23 req-efda649a-d8a7-4a65-ab91-291c3c69dea4 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:09.192205 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-52f13f5e-a47d-4cbb-bbd9-ad606434dc23 req-efda649a-d8a7-4a65-ab91-291c3c69dea4 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0668714 Jun 17 11:00:09.239302 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-52f13f5e-a47d-4cbb-bbd9-ad606434dc23 req-8942e707-ffab-4c4d-a458-a09b50935f75 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411682 Jun 17 11:00:09.345250 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5b49921-9268-4697-8fb8-2b795dc8c7d1 req-6dc6a80f-ae9e-4bf0-ba81-b741a1469a97 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:09.346657 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d5b49921-9268-4697-8fb8-2b795dc8c7d1 req-6dc6a80f-ae9e-4bf0-ba81-b741a1469a97 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0643542 Jun 17 11:00:09.383497 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d5b49921-9268-4697-8fb8-2b795dc8c7d1 req-cb582116-fd5b-46fb-8af9-6dc7d99ce201 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313797 Jun 17 11:00:10.323053 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dca470d3-dd74-472a-ad35-ed62a779976b req-f10fc55e-7b2e-430c-afe2-58128af3ad95 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:10.327591 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-dca470d3-dd74-472a-ad35-ed62a779976b req-f10fc55e-7b2e-430c-afe2-58128af3ad95 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0841007 Jun 17 11:00:10.371199 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-dca470d3-dd74-472a-ad35-ed62a779976b req-edc833ae-9fd5-4f6b-bbec-1e782009b7f1 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391123 Jun 17 11:00:10.473349 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b2bae85-cee9-43cd-9247-cf59d80238cb req-148c77a7-a13b-4c97-9cb4-f65c3559eb67 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:10.474840 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9b2bae85-cee9-43cd-9247-cf59d80238cb req-148c77a7-a13b-4c97-9cb4-f65c3559eb67 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0666535 Jun 17 11:00:10.523423 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9b2bae85-cee9-43cd-9247-cf59d80238cb req-2090fca1-477e-49b9-98e6-0b826fcf356c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422580 Jun 17 11:00:10.749391 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3470ad4e-7aa7-46db-a88c-d6e48d8cf3dc req-a48e267d-7e04-42d4-9298-78457c6853e9 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:10.751159 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3470ad4e-7aa7-46db-a88c-d6e48d8cf3dc req-a48e267d-7e04-42d4-9298-78457c6853e9 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0715561 Jun 17 11:00:10.752926 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf37827-4ac3-4f50-83d0-24a9990a9cb1 req-6c318c5a-3f4d-4037-8525-c7fda4c7042d tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:10.754433 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-adf37827-4ac3-4f50-83d0-24a9990a9cb1 req-6c318c5a-3f4d-4037-8525-c7fda4c7042d tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0761204 Jun 17 11:00:10.762820 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 60506) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:10.767424 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-34a1de79-0c65-4f52-8f5f-4cbad1edaf3b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'floatingip': {'port_id': '584d5dfc-3f46-4820-80b2-e729ce075654'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:00:10.794371 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3470ad4e-7aa7-46db-a88c-d6e48d8cf3dc req-003cb22e-ac4c-4656-838a-2b018971d36f tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372329 Jun 17 11:00:10.838185 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-34a1de79-0c65-4f52-8f5f-4cbad1edaf3b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:11.677737 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-34a1de79-0c65-4f52-8f5f-4cbad1edaf3b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:11.692279 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ef1074-3cfd-4b92-986c-d17588a9703a req-5d9274b1-ae52-4ffd-aa03-96e4c3c656e9 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:11.693724 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a4ef1074-3cfd-4b92-986c-d17588a9703a req-5d9274b1-ae52-4ffd-aa03-96e4c3c656e9 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.1851056 Jun 17 11:00:11.737871 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a4ef1074-3cfd-4b92-986c-d17588a9703a req-35add900-c218-49dd-ac67-ecf707c2055c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382576 Jun 17 11:00:11.749756 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-34a1de79-0c65-4f52-8f5f-4cbad1edaf3b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:11.858425 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.l3_db [None req-34a1de79-0c65-4f52-8f5f-4cbad1edaf3b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Floating IP a57b1ca8-3f63-4809-bc21-3fe5eddb3498 associated. External IP: 172.27.3.86, port: 584d5dfc-3f46-4820-80b2-e729ce075654. Jun 17 11:00:12.061787 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-34a1de79-0c65-4f52-8f5f-4cbad1edaf3b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Router a17f3ab0-fe2c-4834-806d-28b3794b6366 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:00:12.163936 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34a1de79-0c65-4f52-8f5f-4cbad1edaf3b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:00:12.168764 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-34a1de79-0c65-4f52-8f5f-4cbad1edaf3b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:12.176069 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8fc50d1-38d3-46e7-9c33-1e131ad26e32 None None] Sync routers for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:00:12.184887 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8fc50d1-38d3-46e7-9c33-1e131ad26e32 None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:00:12.185488 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-c8fc50d1-38d3-46e7-9c33-1e131ad26e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T10:59:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:00:12.216442 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-34a1de79-0c65-4f52-8f5f-4cbad1edaf3b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "PUT /v2.0/floatingips/a57b1ca8-3f63-4809-bc21-3fe5eddb3498 HTTP/1.1" status: 200 len: 990 time: 1.4428816 Jun 17 11:00:12.216442 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0878d13b-20f2-49ea-8fe7-94094628f250', 'tag': '584d5dfc-3f46-4820-80b2-e729ce075654'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:00:12.216442 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9cd2220-70ba-4d43-8b1c-475c8502409a" -d '{"events": [{"name": "network-changed", "server_uuid": "0878d13b-20f2-49ea-8fe7-94094628f250", "tag": "584d5dfc-3f46-4820-80b2-e729ce075654"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:00:12.257112 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:00:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eec3b245-7aec-408b-af5b-2866251f3742 x-openstack-request-id: req-eec3b245-7aec-408b-af5b-2866251f3742 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:00:12.257426 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0878d13b-20f2-49ea-8fe7-94094628f250", "tag": "584d5dfc-3f46-4820-80b2-e729ce075654", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:00:12.257698 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-eec3b245-7aec-408b-af5b-2866251f3742 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:00:12.258433 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0878d13b-20f2-49ea-8fe7-94094628f250', 'tag': '584d5dfc-3f46-4820-80b2-e729ce075654', 'status': 'completed', 'code': 200} Jun 17 11:00:12.298975 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-c8fc50d1-38d3-46e7-9c33-1e131ad26e32 None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:00:12.566049 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-c8fc50d1-38d3-46e7-9c33-1e131ad26e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'a57b1ca8-3f63-4809-bc21-3fe5eddb3498', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'floating_ip_address': '172.27.3.86', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'port_id': '584d5dfc-3f46-4820-80b2-e729ce075654', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 107, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'mac_address': 'fa:16:3e:e1:22:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0878d13b-20f2-49ea-8fe7-94094628f250', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T10:59:24Z', 'updated_at': '2021-06-17T11:00:11Z', 'revision_number': 1, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:00:12.582310 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8fc50d1-38d3-46e7-9c33-1e131ad26e32 None None] Checking router: a17f3ab0-fe2c-4834-806d-28b3794b6366 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:00:12.590563 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8fc50d1-38d3-46e7-9c33-1e131ad26e32 None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:00:12.593264 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-c8fc50d1-38d3-46e7-9c33-1e131ad26e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T10:59:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:00:12.695856 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-c8fc50d1-38d3-46e7-9c33-1e131ad26e32 None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:00:12.917312 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-c8fc50d1-38d3-46e7-9c33-1e131ad26e32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'a57b1ca8-3f63-4809-bc21-3fe5eddb3498', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'floating_ip_address': '172.27.3.86', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'port_id': '584d5dfc-3f46-4820-80b2-e729ce075654', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 107, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'mac_address': 'fa:16:3e:e1:22:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0878d13b-20f2-49ea-8fe7-94094628f250', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T10:59:24Z', 'updated_at': '2021-06-17T11:00:11Z', 'revision_number': 1, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:00:12.943579 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8fc50d1-38d3-46e7-9c33-1e131ad26e32 None None] The sync data for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi is: [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'a57b1ca8-3f63-4809-bc21-3fe5eddb3498', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'floating_ip_address': '172.27.3.86', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'port_id': '584d5dfc-3f46-4820-80b2-e729ce075654', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 107, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'mac_address': 'fa:16:3e:e1:22:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0878d13b-20f2-49ea-8fe7-94094628f250', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T10:59:24Z', 'updated_at': '2021-06-17T11:00:11Z', 'revision_number': 1, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:00:13.172307 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-979fe851-38c4-4bf7-9c19-e1a4a1fb78ba None None] New status for floating IP a57b1ca8-3f63-4809-bc21-3fe5eddb3498: ACTIVE {{(pid=110216) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:00:15.366665 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9cd2220-70ba-4d43-8b1c-475c8502409a req-cff62a97-cdf0-4398-9836-17c6bbecd627 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:15.368160 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9cd2220-70ba-4d43-8b1c-475c8502409a req-cff62a97-cdf0-4398-9836-17c6bbecd627 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 1098 time: 0.0519724 Jun 17 11:00:15.511625 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9cd2220-70ba-4d43-8b1c-475c8502409a req-cf18dc38-53fe-4d8a-99f8-99d785e98178 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:15.513016 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9cd2220-70ba-4d43-8b1c-475c8502409a req-cf18dc38-53fe-4d8a-99f8-99d785e98178 service neutron] 10.222.0.25 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 911 time: 0.0894110 Jun 17 11:00:15.605220 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9cd2220-70ba-4d43-8b1c-475c8502409a req-e3a2a22c-b9b0-4881-b524-74a844f4b72b service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=584d5dfc-3f46-4820-80b2-e729ce075654 HTTP/1.1" status: 200 len: 1000 time: 0.0856504 Jun 17 11:00:15.659768 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9cd2220-70ba-4d43-8b1c-475c8502409a req-09330732-53ab-4212-a209-a7c3e288ea73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:15.661236 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9cd2220-70ba-4d43-8b1c-475c8502409a req-09330732-53ab-4212-a209-a7c3e288ea73 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 200 len: 849 time: 0.0481315 Jun 17 11:00:15.953262 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9cd2220-70ba-4d43-8b1c-475c8502409a req-0f366a35-38bb-4f42-a309-60bce7f31b9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:15.954720 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9cd2220-70ba-4d43-8b1c-475c8502409a req-0f366a35-38bb-4f42-a309-60bce7f31b9e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=54973ccd-0b2b-4517-ad28-76a3128a2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2823763 Jun 17 11:00:16.047967 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9cd2220-70ba-4d43-8b1c-475c8502409a req-d49e1bf3-0838-4784-b325-213dce8f64fd service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859337 Jun 17 11:00:16.139282 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9cd2220-70ba-4d43-8b1c-475c8502409a req-6f5baa63-9d51-4a04-81dd-a4e59093e575 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0792031 Jun 17 11:00:20.657591 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-bf81d202-025e-495f-adc8-5ee314af2271 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:23.324565 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-bf1b2811-e341-49d7-9420-a8f3a399e0b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:23.566435 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:24.054750 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:00:24.468803 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:26.811094 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:30.442461 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6c808092-da0f-4549-8ec8-5877a037c1dc req-e7517235-3877-4346-b313-0d861ec3c102 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0560458 Jun 17 11:00:30.545138 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c808092-da0f-4549-8ec8-5877a037c1dc req-2354d801-b458-4ac3-b32b-d40d5cd67b30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:30.546615 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6c808092-da0f-4549-8ec8-5877a037c1dc req-2354d801-b458-4ac3-b32b-d40d5cd67b30 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 1098 time: 0.0524402 Jun 17 11:00:30.676398 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c808092-da0f-4549-8ec8-5877a037c1dc req-bf27eb1a-b3d3-4938-875c-0b3df231e5e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:30.678174 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6c808092-da0f-4549-8ec8-5877a037c1dc req-bf27eb1a-b3d3-4938-875c-0b3df231e5e4 service neutron] 10.222.0.25 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 915 time: 0.1048839 Jun 17 11:00:30.723642 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6c808092-da0f-4549-8ec8-5877a037c1dc req-3d94c483-16ac-4cb5-89fc-44be66233848 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d HTTP/1.1" status: 200 len: 217 time: 0.0374365 Jun 17 11:00:30.773176 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c808092-da0f-4549-8ec8-5877a037c1dc req-31302773-9680-4d48-9406-66f9883bdc55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:30.774583 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6c808092-da0f-4549-8ec8-5877a037c1dc req-31302773-9680-4d48-9406-66f9883bdc55 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=c10bc074-5591-4fbf-953f-e4097d48cc79 HTTP/1.1" status: 200 len: 854 time: 0.0433619 Jun 17 11:00:30.816183 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6c808092-da0f-4549-8ec8-5877a037c1dc req-86cd6a97-1bcf-4d01-85a2-f078de38c907 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0261126 Jun 17 11:00:30.908617 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6c808092-da0f-4549-8ec8-5877a037c1dc req-ede379d2-2e59-401d-9ac3-9f237cfab564 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822625 Jun 17 11:00:31.005967 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6c808092-da0f-4549-8ec8-5877a037c1dc req-6abce2c9-ee24-4855-ba11-d8d744f4e858 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830586 Jun 17 11:00:34.102652 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 32822) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:34.226469 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:34.276409 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-cdf794bc-3323-4371-a31d-66a3d50570a7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:34.277868 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-cdf794bc-3323-4371-a31d-66a3d50570a7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 814 time: 0.1112597 Jun 17 11:00:34.293063 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-25394d55-48c9-4c8e-99af-6309eb169ec5 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/quotas/5a3d5a50b1194ca594e398fd941cbe5f HTTP/1.1" status: 200 len: 375 time: 0.0092437 Jun 17 11:00:34.328478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:34.371385 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:34.381042 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:34.387632 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-d01db133-8847-4404-b94a-e1e217124f4f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0895951 Jun 17 11:00:34.426291 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=f48fecbb94284a4ea8bea8cc9a091727&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3218184 Jun 17 11:00:34.429621 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 32846) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:34.436755 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea8cb19a-cfec-42c8-a79a-3d68cbd65740,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:34.452374 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.452724 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.453245 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.453740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.454229 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.454718 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.455284 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.456600 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.457096 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.457565 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.458047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.458959 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:34.463023 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:34.505641 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-89b7085b-ad23-4cce-954b-dbf3083e83bc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:34.517849 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-22b8c0cf-e2b2-49d8-b742-7fc24b8e2e82 service neutron] 10.222.0.41 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1224804 Jun 17 11:00:34.520682 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:34.541106 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-89b7085b-ad23-4cce-954b-dbf3083e83bc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:34.624357 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88b4d37e-3eb0-4297-8aa4-4d61572e5398 service neutron] 10.222.0.41 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0984731 Jun 17 11:00:34.679573 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-89b7085b-ad23-4cce-954b-dbf3083e83bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:34.682625 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-89b7085b-ad23-4cce-954b-dbf3083e83bc admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:34.686503 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-89b7085b-ad23-4cce-954b-dbf3083e83bc admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/ea8cb19a-cfec-42c8-a79a-3d68cbd65740 HTTP/1.1" status: 204 len: 168 time: 0.2534504 Jun 17 11:00:34.686503 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:34.694443 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89b7085b-ad23-4cce-954b-dbf3083e83bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea8cb19a-cfec-42c8-a79a-3d68cbd65740,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:34.696712 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-89b7085b-ad23-4cce-954b-dbf3083e83bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:34.876649 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fa633615-f47f-4cb1-a7a2-ad4cff6dd69b req-209e4f7b-6ba1-4ac2-ba42-e95ebf89dd97 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 210 time: 0.0433118 Jun 17 11:00:35.570959 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 32894) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:35.591083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4d273c0e-73a4-4c18-98b0-aecd257a1219 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:35.681739 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4d273c0e-73a4-4c18-98b0-aecd257a1219 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:35.782797 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4d273c0e-73a4-4c18-98b0-aecd257a1219 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:35.786423 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:35.825733 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-4d273c0e-73a4-4c18-98b0-aecd257a1219 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=d8d0cfbfb2c54fe5b41d9afe8744fc77&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2530932 Jun 17 11:00:35.827649 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 32904) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:35.834260 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d273c0e-73a4-4c18-98b0-aecd257a1219 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18400367-37ab-4690-9803-e4fcb59d5c30,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:35.837741 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4d273c0e-73a4-4c18-98b0-aecd257a1219 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:35.880265 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-be3a9998-77bc-4c0a-8530-afadde238774 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:35.901883 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-be3a9998-77bc-4c0a-8530-afadde238774 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:36.007845 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9e2ac2c5-6ee8-4505-bc31-9758437308e2 req-fa84dd9e-8543-44f8-be79-a2db2c87290c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 210 time: 0.0290484 Jun 17 11:00:36.023234 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-be3a9998-77bc-4c0a-8530-afadde238774 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:36.026117 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-be3a9998-77bc-4c0a-8530-afadde238774 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:36.027337 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-be3a9998-77bc-4c0a-8530-afadde238774 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/18400367-37ab-4690-9803-e4fcb59d5c30 HTTP/1.1" status: 204 len: 168 time: 0.1988826 Jun 17 11:00:36.030275 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f44bfa80-5c2b-4346-99a0-b3cc0f6314ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:36.036452 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be3a9998-77bc-4c0a-8530-afadde238774 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18400367-37ab-4690-9803-e4fcb59d5c30,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:36.040102 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-be3a9998-77bc-4c0a-8530-afadde238774 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:37.153427 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-19370d25-556f-4089-85a3-bb67aae52363 req-12ea582e-7756-4eea-96b9-14c65cd40713 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 210 time: 0.0271306 Jun 17 11:00:37.666011 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 32960) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:37.788216 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:37.877619 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:37.959637 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:37.962105 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e9c491eb-de3c-4a48-a38c-b9aa539e29e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:37.999097 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=9c80be7af4384c0b98e1b7391fa92857&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3319700 Jun 17 11:00:38.000242 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d2fe713-2e42-4555-a08a-ef6b4399d3ef,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:38.002043 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 32968) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:38.007700 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.008062 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.008412 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.008753 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.009094 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.009430 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.009764 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.010101 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.010435 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.010787 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.011131 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.011457 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:38.026558 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:38.052979 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-015fe53a-2c82-4e28-afbe-98a621d697b4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:38.083105 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-015fe53a-2c82-4e28-afbe-98a621d697b4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:38.228612 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-015fe53a-2c82-4e28-afbe-98a621d697b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:38.234019 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-015fe53a-2c82-4e28-afbe-98a621d697b4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:38.236025 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-015fe53a-2c82-4e28-afbe-98a621d697b4 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/4d2fe713-2e42-4555-a08a-ef6b4399d3ef HTTP/1.1" status: 204 len: 168 time: 0.2327881 Jun 17 11:00:38.238039 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7145dd04-903a-4ce2-81f7-a9e499bc2d33 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:38.249367 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-015fe53a-2c82-4e28-afbe-98a621d697b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d2fe713-2e42-4555-a08a-ef6b4399d3ef,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:38.252556 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-015fe53a-2c82-4e28-afbe-98a621d697b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:38.304890 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-559fa765-1524-4261-bc02-5e3edd6ca289 req-6b887756-3e99-4a05-a166-4d2f04a32b75 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 210 time: 0.0329027 Jun 17 11:00:39.448951 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-abcdea02-509d-48a3-8b89-d2e44b157d89 req-27acb573-f60f-4c71-82be-ed000edfc871 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 210 time: 0.0316734 Jun 17 11:00:40.594525 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c3a56203-49cc-4169-afd5-de40eb624c43 req-cad4a41b-3b4e-4343-844b-a1f5c88ffe07 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 210 time: 0.0318406 Jun 17 11:00:41.308382 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-661689f7-ad1c-445b-a47c-f45fea0555f8 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:41.309860 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-661689f7-ad1c-445b-a47c-f45fea0555f8 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 814 time: 0.1144879 Jun 17 11:00:41.325687 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Request body: {'port': {'device_id': '994a1663-51bc-401a-969e-e74abbe386f5', 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b', 'admin_state_up': True, 'tenant_id': '5a3d5a50b1194ca594e398fd941cbe5f'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:00:41.565600 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Made reservation on behalf of 5a3d5a50b1194ca594e398fd941cbe5f for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:00:41.569242 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:41.712509 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Allocated IP 172.20.0.7 (bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b/c10bc074-5591-4fbf-953f-e4097d48cc79/b9d0052c-f650-4dae-8e30-09f806a67cfb) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:00:41.773122 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-99378f92-70dc-4d36-aba2-e7a47aba67e3 req-5257bc45-3dd7-46f8-a453-7ff402f75d43 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 210 time: 0.0319753 Jun 17 11:00:41.881642 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:41.988871 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:41.994636 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:42.035382 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:00:42.039666 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:00:42.040305 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5df2bc70-d7c4-4355-b3d7-81d2732dfd9d'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:00:42.042052 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:00:42.079093 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Pushing event updated for resources: {'Port': ['ID=b9d0052c-f650-4dae-8e30-09f806a67cfb,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:42.083556 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:42.115587 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:42.117088 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.234932 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9081616 Jun 17 11:00:42.243728 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Request body: {'port': {'device_id': '994a1663-51bc-401a-969e-e74abbe386f5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:00:42.283790 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33136) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:42.324033 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.333028 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_v2 [None req-c4abb45a-f49c-429e-bf60-0580a5778d5e admin admin] Deleting subnet 07c3aa71-3bf0-4bb5-90f7-6a0307254f38 {{(pid=110214) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:00:42.336297 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c4abb45a-f49c-429e-bf60-0580a5778d5e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.385569 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c4abb45a-f49c-429e-bf60-0580a5778d5e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6228443'] for subnet, precommit_delete_associations {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.464469 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c4abb45a-f49c-429e-bf60-0580a5778d5e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.594456 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c4abb45a-f49c-429e-bf60-0580a5778d5e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6239301', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5530029'] for subnet, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.598284 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-651832e6-c94f-49d9-b958-e8cb0d86cb8a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:42.623139 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4abb45a-f49c-429e-bf60-0580a5778d5e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=07c3aa71-3bf0-4bb5-90f7-6a0307254f38,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:42.624705 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-c4abb45a-f49c-429e-bf60-0580a5778d5e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:42.625689 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c4abb45a-f49c-429e-bf60-0580a5778d5e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.627563 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-c4abb45a-f49c-429e-bf60-0580a5778d5e admin admin] 10.222.0.41 "DELETE /v2.0/subnets/07c3aa71-3bf0-4bb5-90f7-6a0307254f38 HTTP/1.1" status: 204 len: 168 time: 0.3426175 Jun 17 11:00:42.630051 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33150) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:42.636903 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b9d0052c-f650-4dae-8e30-09f806a67cfb {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:00:42.644193 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.657056 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Transition to ACTIVE for port object b9d0052c-f650-4dae-8e30-09f806a67cfb will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:00:42.700735 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.727649 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.738795 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:42.796913 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.807167 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['61bd7470-9de2-46ad-a73c-0c5a775b3c55']}} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:00:42.816923 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7fc7865d-5397-411f-a202-d852a3759824') {'for_net_delete': True} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:00:42.817654 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7fc7865d-5397-411f-a202-d852a3759824') {} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:00:42.834350 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6228436'] for segment, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.843210 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.851084 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110214) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:00:42.851531 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6239464'] for segment, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.869941 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Pushing event updated for resources: {'Port': ['ID=b9d0052c-f650-4dae-8e30-09f806a67cfb,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:42.875044 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:42.885457 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Attempting to bind port b9d0052c-f650-4dae-8e30-09f806a67cfb on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:00:42.886218 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Attempting to bind port b9d0052c-f650-4dae-8e30-09f806a67cfb by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:00:42.886218 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Attempting to bind port b9d0052c-f650-4dae-8e30-09f806a67cfb on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:00:42.891452 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Port b9d0052c-f650-4dae-8e30-09f806a67cfb on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:00:42.895248 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Attempting to bind port b9d0052c-f650-4dae-8e30-09f806a67cfb on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:00:42.899492 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:00:42.899915 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Checking segment: {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:00:42.900348 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Bound using segment: {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:00:42.900870 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Bound port: b9d0052c-f650-4dae-8e30-09f806a67cfb, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:00:42.901301 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: retrieve_revision_numbers = { Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: retrieve_revision_numbers = { Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: Traceback (most recent call last): Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: timer() Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: cb(*args, **kw) Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: return func(*args, **kwargs) Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: self._notify() Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: self.callback(batched_events) Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: event.method(event) Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: return f(self, *a, **k) Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._get(url).json() Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: return self.request(url, 'GET', **kwargs) Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:00:42.910531 dv-cinder-773870-6-iscsi neutron-server[110214]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:00:42.970484 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] For port b9d0052c-f650-4dae-8e30-09f806a67cfb, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:00:42.974252 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] For port b9d0052c-f650-4dae-8e30-09f806a67cfb, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=b9d0052c-f650-4dae-8e30-09f806a67cfb,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:00:43.001311 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-887629cd-d6a3-4e17-9ec4-498113ba5c50 req-315f46bb-5ff4-493f-b68a-91e8d1c9e736 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:43.002821 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-887629cd-d6a3-4e17-9ec4-498113ba5c50 req-315f46bb-5ff4-493f-b68a-91e8d1c9e736 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 943 time: 0.0636182 Jun 17 11:00:43.041111 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.065963 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-887629cd-d6a3-4e17-9ec4-498113ba5c50 req-4de74261-1dd1-40ac-87ff-d0f0ef17ff98 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569129 Jun 17 11:00:43.067665 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:43.070704 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.072544 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] 10.222.0.41 "DELETE /v2.0/networks/61bd7470-9de2-46ad-a73c-0c5a775b3c55 HTTP/1.1" status: 204 len: 168 time: 0.4415176 Jun 17 11:00:43.075494 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33166) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:43.101849 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] Pushing event deleted for resources: {'Network': ['ID=61bd7470-9de2-46ad-a73c-0c5a775b3c55,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:43.107493 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:43.127816 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_v2 [None req-f40f7950-d0c3-42ca-a5bd-30af6fd321bd admin admin] Deleting subnet ae069949-6a04-4c6a-b60f-f21a64196304 {{(pid=110215) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:00:43.130244 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.133874 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f40f7950-d0c3-42ca-a5bd-30af6fd321bd admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.136070 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:43.193132 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:43.193753 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.195148 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] 10.222.0.25 "PUT /v2.0/ports/b9d0052c-f650-4dae-8e30-09f806a67cfb HTTP/1.1" status: 200 len: 1093 time: 0.9578462 Jun 17 11:00:43.197171 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '994a1663-51bc-401a-969e-e74abbe386f5', 'tag': 'b9d0052c-f650-4dae-8e30-09f806a67cfb'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:00:43.199510 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c552e1dd-1e18-42c9-8803-6fc5e8a3bf87" -d '{"events": [{"name": "network-changed", "server_uuid": "994a1663-51bc-401a-969e-e74abbe386f5", "tag": "b9d0052c-f650-4dae-8e30-09f806a67cfb"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:00:43.230421 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f40f7950-d0c3-42ca-a5bd-30af6fd321bd admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6032829'] for subnet, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.256278 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:00:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b9dbae05-3a3a-44e8-9748-0e279f23bbb8 x-openstack-request-id: req-b9dbae05-3a3a-44e8-9748-0e279f23bbb8 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:00:43.256813 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "994a1663-51bc-401a-969e-e74abbe386f5", "tag": "b9d0052c-f650-4dae-8e30-09f806a67cfb", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:00:43.257117 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-b9dbae05-3a3a-44e8-9748-0e279f23bbb8 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:00:43.257532 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '994a1663-51bc-401a-969e-e74abbe386f5', 'tag': 'b9d0052c-f650-4dae-8e30-09f806a67cfb', 'status': 'completed', 'code': 200} Jun 17 11:00:43.261210 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Pushing event updated for resources: {'Port': ['ID=b9d0052c-f650-4dae-8e30-09f806a67cfb,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:43.265547 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:43.289329 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f40f7950-d0c3-42ca-a5bd-30af6fd321bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.373871 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c552e1dd-1e18-42c9-8803-6fc5e8a3bf87 req-26d40d67-ebad-4738-bf91-fabc2290cb83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:43.375437 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c552e1dd-1e18-42c9-8803-6fc5e8a3bf87 req-26d40d67-ebad-4738-bf91-fabc2290cb83 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 1096 time: 0.0979230 Jun 17 11:00:43.432740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f40f7950-d0c3-42ca-a5bd-30af6fd321bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5898882', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5636066'] for subnet, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.450858 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8fc77c07-8e18-447c-9cd4-7731a3f2f61a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:43.530419 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f40f7950-d0c3-42ca-a5bd-30af6fd321bd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ae069949-6a04-4c6a-b60f-f21a64196304,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:43.534239 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f40f7950-d0c3-42ca-a5bd-30af6fd321bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:43.543332 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f40f7950-d0c3-42ca-a5bd-30af6fd321bd admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.545446 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f40f7950-d0c3-42ca-a5bd-30af6fd321bd admin admin] 10.222.0.41 "DELETE /v2.0/subnets/ae069949-6a04-4c6a-b60f-f21a64196304 HTTP/1.1" status: 204 len: 168 time: 0.4687192 Jun 17 11:00:43.548056 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33192) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:43.585033 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c552e1dd-1e18-42c9-8803-6fc5e8a3bf87 req-15ba4130-44a3-4344-b89a-96afd117dd19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:43.586928 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c552e1dd-1e18-42c9-8803-6fc5e8a3bf87 req-15ba4130-44a3-4344-b89a-96afd117dd19 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&shared=False HTTP/1.1" status: 200 len: 915 time: 0.2030416 Jun 17 11:00:43.643001 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.728280 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.738654 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3984fc37-eb92-40cf-b691-87dfc8d275f1']}} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:00:43.748175 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a21035cd-067b-49c3-a0b1-142ba9def056') {'for_net_delete': True} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:00:43.748468 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a21035cd-067b-49c3-a0b1-142ba9def056') {} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:00:43.758804 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6228436'] for segment, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.776699 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.782641 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] Releasing vlan 134 on physical network physnet1 to pool {{(pid=110214) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:00:43.783070 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6239464'] for segment, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: Traceback (most recent call last): Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: timer() Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: cb(*args, **kw) Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: return func(*args, **kwargs) Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: self._notify() Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: self.callback(batched_events) Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: event.method(event) Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: return f(self, *a, **k) Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._get(url).json() Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: return self.request(url, 'GET', **kwargs) Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:00:43.784740 dv-cinder-773870-6-iscsi neutron-server[110214]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:00:43.919889 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.923928 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:43.929213 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:43.930167 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] 10.222.0.41 "DELETE /v2.0/networks/3984fc37-eb92-40cf-b691-87dfc8d275f1 HTTP/1.1" status: 204 len: 168 time: 0.3810430 Jun 17 11:00:43.938968 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] Pushing event deleted for resources: {'Network': ['ID=3984fc37-eb92-40cf-b691-87dfc8d275f1,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:43.941108 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:44.245640 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63193657-dbf4-4fe4-9dd1-16c129cdfbd2 req-5c0d2651-0631-48a5-bbdf-2a4dfa8ad597 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:44.247144 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-63193657-dbf4-4fe4-9dd1-16c129cdfbd2 req-5c0d2651-0631-48a5-bbdf-2a4dfa8ad597 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 943 time: 0.0624704 Jun 17 11:00:44.278711 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33222) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:44.291415 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-63193657-dbf4-4fe4-9dd1-16c129cdfbd2 req-0474816d-d8f1-42b3-a26c-d90e72932741 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372555 Jun 17 11:00:44.319989 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33224) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:44.321026 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-13997ea0-f0f9-4f04-b6be-e6e6114b64ba admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=467d78e8abb1441fa92c4f6d79a58e67&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0410929 Jun 17 11:00:44.323221 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33226) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:44.377632 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0aa77d59-fde2-40bb-9077-7e5db66cc509 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:44.413719 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0aa77d59-fde2-40bb-9077-7e5db66cc509 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:44.500832 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8f04958f-e092-4837-ad34-d0243a069672 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:44.531208 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0aa77d59-fde2-40bb-9077-7e5db66cc509 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:44.534451 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0aa77d59-fde2-40bb-9077-7e5db66cc509 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:44.535631 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-0aa77d59-fde2-40bb-9077-7e5db66cc509 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/b49b10d8-4dfb-484f-9b3d-45b8c1653667 HTTP/1.1" status: 204 len: 168 time: 0.2115183 Jun 17 11:00:44.536351 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-35e2256b-b4a5-4df4-ad9b-7e4533ee1aab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:44.543886 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aa77d59-fde2-40bb-9077-7e5db66cc509 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b49b10d8-4dfb-484f-9b3d-45b8c1653667,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:44.549394 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0aa77d59-fde2-40bb-9077-7e5db66cc509 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:44.646440 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8f04958f-e092-4837-ad34-d0243a069672 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:44.731147 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8f04958f-e092-4837-ad34-d0243a069672 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:44.734781 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3438ae11-8c5d-4099-9e7a-036a124d0a3c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:44.770967 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-8f04958f-e092-4837-ad34-d0243a069672 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=be077084db2c43fdbfe80ff565e9f813&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4498296 Jun 17 11:00:44.771903 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f04958f-e092-4837-ad34-d0243a069672 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2feb099a-81c4-483e-bd80-54ad4ee6af9a,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:44.773616 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33236) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:44.775650 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8f04958f-e092-4837-ad34-d0243a069672 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:44.821794 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-df7600c1-cd54-410a-9a28-61a762b590df admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:44.843731 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-df7600c1-cd54-410a-9a28-61a762b590df admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:44.953549 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-df7600c1-cd54-410a-9a28-61a762b590df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:44.956849 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-df7600c1-cd54-410a-9a28-61a762b590df admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:44.958026 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-df7600c1-cd54-410a-9a28-61a762b590df admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/2feb099a-81c4-483e-bd80-54ad4ee6af9a HTTP/1.1" status: 204 len: 168 time: 0.1833150 Jun 17 11:00:44.958789 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5b4ab795-08e7-4719-bf5b-7de1fe4411a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:44.966323 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7600c1-cd54-410a-9a28-61a762b590df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2feb099a-81c4-483e-bd80-54ad4ee6af9a,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:44.968766 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-df7600c1-cd54-410a-9a28-61a762b590df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:45.141117 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33246) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:45.176000 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-59a95ff5-ff0a-4476-8b8e-62f14d68c3d3 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=9b5534862d8f4252bbab968b49bb2187&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0371482 Jun 17 11:00:45.178319 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33248) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:45.225802 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6bef6bb0-8378-4ca4-9bb3-58e771172dc6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:45.250011 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6bef6bb0-8378-4ca4-9bb3-58e771172dc6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:45.353861 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6bef6bb0-8378-4ca4-9bb3-58e771172dc6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:45.356525 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6bef6bb0-8378-4ca4-9bb3-58e771172dc6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:45.357718 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-6bef6bb0-8378-4ca4-9bb3-58e771172dc6 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/2cb1ac47-e5c3-4c7e-8e5a-629be5de5810 HTTP/1.1" status: 204 len: 168 time: 0.1784916 Jun 17 11:00:45.358665 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6d48eea2-f433-49ca-b1ad-d6b3e5c9fc0f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:45.367239 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bef6bb0-8378-4ca4-9bb3-58e771172dc6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cb1ac47-e5c3-4c7e-8e5a-629be5de5810,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:45.369654 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6bef6bb0-8378-4ca4-9bb3-58e771172dc6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:45.469654 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32edb037-223e-4751-af14-6927836ac06e req-16431341-dd3c-46aa-93de-074201b6925e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:45.471670 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-32edb037-223e-4751-af14-6927836ac06e req-16431341-dd3c-46aa-93de-074201b6925e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 943 time: 0.0662386 Jun 17 11:00:45.510022 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-32edb037-223e-4751-af14-6927836ac06e req-3c50c9c7-3f2f-40c2-9ce4-8121602f0b49 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323670 Jun 17 11:00:45.584051 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33258) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:45.597451 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5cf62a71-41e6-4745-be1c-6282c4abd8ae admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:45.688387 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5cf62a71-41e6-4745-be1c-6282c4abd8ae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:45.736347 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5cf62a71-41e6-4745-be1c-6282c4abd8ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:45.739538 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-15f1c3a9-f508-4e5a-bd5b-e69d75f735e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:45.775089 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cf62a71-41e6-4745-be1c-6282c4abd8ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c113fb5e-c43a-441d-bd42-a0a54095ee1c,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:45.781320 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-5cf62a71-41e6-4745-be1c-6282c4abd8ae admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=41c3a48172464c3683275a1d507cfdd9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1961825 Jun 17 11:00:45.782520 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5cf62a71-41e6-4745-be1c-6282c4abd8ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:45.784748 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33266) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:45.858535 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2d2c176f-2582-4bc4-9982-187addd75adb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:45.880676 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2d2c176f-2582-4bc4-9982-187addd75adb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:45.929604 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c552e1dd-1e18-42c9-8803-6fc5e8a3bf87 req-e557f059-223d-4d15-9646-337b9da8df9c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:45.931074 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c552e1dd-1e18-42c9-8803-6fc5e8a3bf87 req-e557f059-223d-4d15-9646-337b9da8df9c service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1728497 Jun 17 11:00:45.999632 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2d2c176f-2582-4bc4-9982-187addd75adb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:46.002353 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2d2c176f-2582-4bc4-9982-187addd75adb admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:46.003635 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-2d2c176f-2582-4bc4-9982-187addd75adb admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/c113fb5e-c43a-441d-bd42-a0a54095ee1c HTTP/1.1" status: 204 len: 168 time: 0.2181177 Jun 17 11:00:46.004574 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d83cef81-b6fc-4b15-8127-f90d386d1d3d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:46.014193 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2c176f-2582-4bc4-9982-187addd75adb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c113fb5e-c43a-441d-bd42-a0a54095ee1c,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:46.024378 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2d2c176f-2582-4bc4-9982-187addd75adb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:46.685453 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0185ef8c-8197-43b4-bfab-6b5ddfe005ab req-971a78b7-c485-4fe8-b3da-f279933ce18a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:46.686955 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0185ef8c-8197-43b4-bfab-6b5ddfe005ab req-971a78b7-c485-4fe8-b3da-f279933ce18a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 943 time: 0.0654902 Jun 17 11:00:46.751880 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0185ef8c-8197-43b4-bfab-6b5ddfe005ab req-efaeca2f-36df-4d23-9e6c-756092d73d3d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579381 Jun 17 11:00:46.991616 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33322) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:47.093444 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0df37b7e-d385-479a-a608-12359f6cdd4a admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:47.180026 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0df37b7e-d385-479a-a608-12359f6cdd4a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:47.284639 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0df37b7e-d385-479a-a608-12359f6cdd4a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:47.284639 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:47.319566 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-0df37b7e-d385-479a-a608-12359f6cdd4a admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=24aa4f6dcda8420eb233de9f53dae1fd&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3268280 Jun 17 11:00:47.320567 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0df37b7e-d385-479a-a608-12359f6cdd4a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd0d313f-c022-4c29-9cba-165fde24dc05,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:47.322329 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33336) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:47.328748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0df37b7e-d385-479a-a608-12359f6cdd4a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:47.372370 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0d6c7b7-95ea-48d2-a65e-c0aa49ea725e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:47.393475 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0d6c7b7-95ea-48d2-a65e-c0aa49ea725e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:47.507883 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0d6c7b7-95ea-48d2-a65e-c0aa49ea725e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:47.510642 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0d6c7b7-95ea-48d2-a65e-c0aa49ea725e admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:47.511816 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-d0d6c7b7-95ea-48d2-a65e-c0aa49ea725e admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/dd0d313f-c022-4c29-9cba-165fde24dc05 HTTP/1.1" status: 204 len: 168 time: 0.1878388 Jun 17 11:00:47.512657 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-ff56c11c-73bf-4900-8279-37f43c28e16e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:47.520429 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0d6c7b7-95ea-48d2-a65e-c0aa49ea725e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd0d313f-c022-4c29-9cba-165fde24dc05,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:47.533273 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d0d6c7b7-95ea-48d2-a65e-c0aa49ea725e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:47.955058 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5234a8a2-b781-4b16-b9aa-bf5bd67046ef req-bc806972-0da4-49e4-92bd-bb2366d08a30 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:47.957123 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5234a8a2-b781-4b16-b9aa-bf5bd67046ef req-bc806972-0da4-49e4-92bd-bb2366d08a30 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 943 time: 0.0836585 Jun 17 11:00:47.997374 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5234a8a2-b781-4b16-b9aa-bf5bd67046ef req-4bc576d0-3eb3-4d0a-9918-7f1be457e7c1 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0346518 Jun 17 11:00:49.171607 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6f25e06-53ae-412e-9385-bbb73994524e req-5c832737-b7a2-46d8-9882-c29c66a3ff00 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:49.173190 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b6f25e06-53ae-412e-9385-bbb73994524e req-5c832737-b7a2-46d8-9882-c29c66a3ff00 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 943 time: 0.0636313 Jun 17 11:00:49.216722 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b6f25e06-53ae-412e-9385-bbb73994524e req-a12e151d-32af-4feb-b840-4cbab126fd42 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371196 Jun 17 11:00:49.699202 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-42a402f9-ff17-40cf-95bf-27a0c69d3dd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:49.700746 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-42a402f9-ff17-40cf-95bf-27a0c69d3dd0 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 1096 time: 0.0546737 Jun 17 11:00:49.953345 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-58b81dff-fe8e-49d0-a5d0-376503ca39f8 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b9d0052c-f650-4dae-8e30-09f806a67cfb HTTP/1.1" status: 200 len: 217 time: 0.2449508 Jun 17 11:00:50.011478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-5b4e63b9-b74d-4c82-ba54-bd5c94082f01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:50.013128 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-5b4e63b9-b74d-4c82-ba54-bd5c94082f01 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=c10bc074-5591-4fbf-953f-e4097d48cc79 HTTP/1.1" status: 200 len: 854 time: 0.0443368 Jun 17 11:00:50.052384 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-f960fd0e-7f74-435a-86c3-2518b7c77b8a service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0292134 Jun 17 11:00:50.140485 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-4d44683a-8754-49cc-b895-3fe8d2dfbb8b service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842907 Jun 17 11:00:50.235039 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ebfd421-d16d-4a15-b482-7cc60569d286 req-d5313e30-3849-467f-b031-eeb9a05dda97 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0873318 Jun 17 11:00:50.404296 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41cea19-35ce-4be5-a01b-4cd85b900bd9 req-d169e97d-b76b-41be-a91f-08ad5bdc763f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:50.405794 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d41cea19-35ce-4be5-a01b-4cd85b900bd9 req-d169e97d-b76b-41be-a91f-08ad5bdc763f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 943 time: 0.0707474 Jun 17 11:00:50.443745 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d41cea19-35ce-4be5-a01b-4cd85b900bd9 req-22e09357-93a9-43a4-a107-7e1b739691b1 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313892 Jun 17 11:00:50.662795 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-798fda32-0568-4a1c-adfc-a1b196efb593 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:51.646641 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecbd1f8-522d-45d7-a3ad-764814b21856 req-201821ea-edf2-4b63-ace1-ed6f126fc02c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:51.648177 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8ecbd1f8-522d-45d7-a3ad-764814b21856 req-201821ea-edf2-4b63-ace1-ed6f126fc02c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 943 time: 0.0738893 Jun 17 11:00:51.707533 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8ecbd1f8-522d-45d7-a3ad-764814b21856 req-ad074c32-bdaa-46b9-9616-9b0d6b89a5a2 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525854 Jun 17 11:00:52.304262 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33496) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:52.415607 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-cf3e64b9-d285-4925-9d89-a4f71e1c0cfe admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:52.513046 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-cf3e64b9-d285-4925-9d89-a4f71e1c0cfe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:52.564817 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-cf3e64b9-d285-4925-9d89-a4f71e1c0cfe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:52.568880 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:52.620533 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-cf3e64b9-d285-4925-9d89-a4f71e1c0cfe admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=ef42efb8693642b3a24e5060bce2d1cf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3142207 Jun 17 11:00:52.620533 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf3e64b9-d285-4925-9d89-a4f71e1c0cfe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7c39d58a-b977-4f19-8ce9-c60faa1cdd11,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:52.622868 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33508) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:52.624553 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-cf3e64b9-d285-4925-9d89-a4f71e1c0cfe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:52.682692 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63e07dfd-ae84-4762-9701-f60d6e1eb777 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:52.716068 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63e07dfd-ae84-4762-9701-f60d6e1eb777 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:52.863683 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63e07dfd-ae84-4762-9701-f60d6e1eb777 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:52.866475 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63e07dfd-ae84-4762-9701-f60d6e1eb777 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:52.868569 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-63e07dfd-ae84-4762-9701-f60d6e1eb777 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/7c39d58a-b977-4f19-8ce9-c60faa1cdd11 HTTP/1.1" status: 204 len: 168 time: 0.2356253 Jun 17 11:00:52.869189 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f2febd7c-6065-47af-8700-11c448a2e079 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:52.884128 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63e07dfd-ae84-4762-9701-f60d6e1eb777 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c39d58a-b977-4f19-8ce9-c60faa1cdd11,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:52.886502 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-63e07dfd-ae84-4762-9701-f60d6e1eb777 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:52.909764 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19dcd429-c80f-46b1-b823-fb8a1e8cee94 req-9cfb1aae-0bfe-4c36-a801-bab595e30e26 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:52.911470 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-19dcd429-c80f-46b1-b823-fb8a1e8cee94 req-9cfb1aae-0bfe-4c36-a801-bab595e30e26 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 943 time: 0.0887544 Jun 17 11:00:52.953299 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-19dcd429-c80f-46b1-b823-fb8a1e8cee94 req-469c6d5b-50bd-4558-9956-76c794210b66 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328619 Jun 17 11:00:53.336710 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8091203d-f5f3-4707-9052-bb985859f3cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:53.565260 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33552) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:53.576795 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:53.584628 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a2a88970-d5ff-47da-9c04-2f1537cd1588 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:53.695658 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a2a88970-d5ff-47da-9c04-2f1537cd1588 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:53.718690 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c304e5c-7883-4a11-9e0d-9d408e91b6ae req-e750dbf0-7c48-43bf-b4ca-d00028a2dc1b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:53.720238 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c304e5c-7883-4a11-9e0d-9d408e91b6ae req-e750dbf0-7c48-43bf-b4ca-d00028a2dc1b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0852158 Jun 17 11:00:53.761674 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c304e5c-7883-4a11-9e0d-9d408e91b6ae req-9ffa4638-2c3a-4ca5-92d3-d6f75297080f tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347314 Jun 17 11:00:53.776136 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a2a88970-d5ff-47da-9c04-2f1537cd1588 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:53.778539 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:53.788685 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33558) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:53.796685 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device b9d0052c-f650-4dae-8e30-09f806a67cfb details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:00:53.823066 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2a88970-d5ff-47da-9c04-2f1537cd1588 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f09e9a0-30de-424d-b712-ffb9225537b5,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:53.843588 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33564) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:53.844066 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-a2a88970-d5ff-47da-9c04-2f1537cd1588 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=ac74dbbe9346422c8adac1d79a9f9759&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2764621 Jun 17 11:00:53.845282 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a2a88970-d5ff-47da-9c04-2f1537cd1588 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:53.918223 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port b9d0052c-f650-4dae-8e30-09f806a67cfb, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=b9d0052c-f650-4dae-8e30-09f806a67cfb,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:00:53.931586 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': 'b9d0052c-f650-4dae-8e30-09f806a67cfb', 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b', 'port_id': 'b9d0052c-f650-4dae-8e30-09f806a67cfb', 'mac_address': 'fa:16:3e:b0:d3:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c10bc074-5591-4fbf-953f-e4097d48cc79', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:00:53.946535 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4ea24626-4e27-4af4-8190-4158d9b56944 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:53.979299 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f5a713e5-5ad7-444e-a2c1-35107abda7a9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:53.987135 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.002272 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b9d0052c-f650-4dae-8e30-09f806a67cfb {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:00:54.023553 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port b9d0052c-f650-4dae-8e30-09f806a67cfb, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=b9d0052c-f650-4dae-8e30-09f806a67cfb,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:00:54.032095 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4ea24626-4e27-4af4-8190-4158d9b56944 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.107653 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.110041 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:54.148899 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f5a713e5-5ad7-444e-a2c1-35107abda7a9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.199132 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25684463-1fee-4fb5-9e13-fceaa949eb82 req-043b0b98-dae5-499b-b8f9-39472aafe25d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:54.200676 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-25684463-1fee-4fb5-9e13-fceaa949eb82 req-043b0b98-dae5-499b-b8f9-39472aafe25d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 944 time: 0.0839186 Jun 17 11:00:54.207682 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=b9d0052c-f650-4dae-8e30-09f806a67cfb,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:54.215235 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.215564 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.215898 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.216233 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.216663 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.217202 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.217529 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.217857 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.218184 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.218505 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.218825 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.219165 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:00:54.223528 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f5a713e5-5ad7-444e-a2c1-35107abda7a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.224129 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:54.232602 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5470cbf9-253f-4746-8766-d71ccc0997e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:54.241878 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-25684463-1fee-4fb5-9e13-fceaa949eb82 req-b49b6e1b-d576-417f-a010-f2d51623dbd2 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342376 Jun 17 11:00:54.264944 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5a713e5-5ad7-444e-a2c1-35107abda7a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f92a783-fe21-4231-9a74-f2b8415d84c4,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:54.268647 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f5a713e5-5ad7-444e-a2c1-35107abda7a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:54.271324 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f5a713e5-5ad7-444e-a2c1-35107abda7a9 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=3b870d5408544411894d0e128c323e8e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4816570 Jun 17 11:00:54.274338 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33584) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:54.287816 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4ea24626-4e27-4af4-8190-4158d9b56944 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.290571 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4ea24626-4e27-4af4-8190-4158d9b56944 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.292225 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-4ea24626-4e27-4af4-8190-4158d9b56944 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/7f09e9a0-30de-424d-b712-ffb9225537b5 HTTP/1.1" status: 204 len: 168 time: 0.4474206 Jun 17 11:00:54.298129 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-015fe53a-2c82-4e28-afbe-98a621d697b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:54.307928 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea24626-4e27-4af4-8190-4158d9b56944 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f09e9a0-30de-424d-b712-ffb9225537b5,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:54.310121 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4ea24626-4e27-4af4-8190-4158d9b56944 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:54.364905 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-17ad01cc-4b95-4617-a515-7ca0acee6fdd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.387829 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-17ad01cc-4b95-4617-a515-7ca0acee6fdd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.416280 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.495997 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-17ad01cc-4b95-4617-a515-7ca0acee6fdd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.498759 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-17ad01cc-4b95-4617-a515-7ca0acee6fdd admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:54.500290 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-17ad01cc-4b95-4617-a515-7ca0acee6fdd admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/8f92a783-fe21-4231-9a74-f2b8415d84c4 HTTP/1.1" status: 204 len: 168 time: 0.2244959 Jun 17 11:00:54.500981 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:54.509371 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17ad01cc-4b95-4617-a515-7ca0acee6fdd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f92a783-fe21-4231-9a74-f2b8415d84c4,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:54.515871 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-17ad01cc-4b95-4617-a515-7ca0acee6fdd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:54.586612 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['b9d0052c-f650-4dae-8e30-09f806a67cfb'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:00:54.959878 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b718f7a-8b9f-4e02-b87b-230980dd21bd req-b08809b4-1036-4079-9d9f-15545e18b7df tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:54.961428 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0b718f7a-8b9f-4e02-b87b-230980dd21bd req-b08809b4-1036-4079-9d9f-15545e18b7df tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.0818374 Jun 17 11:00:55.011460 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0b718f7a-8b9f-4e02-b87b-230980dd21bd req-e848b9d5-bd74-4203-a859-b479ecc1cde9 tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441012 Jun 17 11:00:55.347546 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33624) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:55.361319 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-91f6cfe0-c5fa-42ac-b539-c6cf4b708e88 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:55.473236 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d780bc91-f251-43f5-8802-84f79dbd7d56 req-7d0622a7-3fac-4927-a055-e2caecdead33 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:55.475540 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d780bc91-f251-43f5-8802-84f79dbd7d56 req-7d0622a7-3fac-4927-a055-e2caecdead33 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 944 time: 0.0968664 Jun 17 11:00:55.477128 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-91f6cfe0-c5fa-42ac-b539-c6cf4b708e88 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:55.530556 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-91f6cfe0-c5fa-42ac-b539-c6cf4b708e88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:55.534135 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:55.539515 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d780bc91-f251-43f5-8802-84f79dbd7d56 req-8015f566-4f73-43b8-801c-0b76f3cf78db tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572431 Jun 17 11:00:55.588711 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-91f6cfe0-c5fa-42ac-b539-c6cf4b708e88 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=b73d998b1c844a9b95d5c5780d0e7baa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2400587 Jun 17 11:00:55.591534 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33636) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:55.617242 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f6cfe0-c5fa-42ac-b539-c6cf4b708e88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa3a9898-17c9-454f-9170-6eb1b0620162,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:55.621029 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-91f6cfe0-c5fa-42ac-b539-c6cf4b708e88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:55.660089 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de56a985-8d14-4a2b-8cc2-3a976364bea1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:55.693238 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de56a985-8d14-4a2b-8cc2-3a976364bea1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:55.779476 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33644) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:55.811415 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de56a985-8d14-4a2b-8cc2-3a976364bea1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:55.815695 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de56a985-8d14-4a2b-8cc2-3a976364bea1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:55.817018 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-de56a985-8d14-4a2b-8cc2-3a976364bea1 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/aa3a9898-17c9-454f-9170-6eb1b0620162 HTTP/1.1" status: 204 len: 168 time: 0.2241447 Jun 17 11:00:55.818266 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4d273c0e-73a4-4c18-98b0-aecd257a1219 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:55.829098 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de56a985-8d14-4a2b-8cc2-3a976364bea1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa3a9898-17c9-454f-9170-6eb1b0620162,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:55.833184 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-de56a985-8d14-4a2b-8cc2-3a976364bea1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:55.993049 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-949e96c1-ab9f-40a2-81b8-8bc79ca00737 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:56.178008 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dff54963-072b-4b24-9fdf-af03820f573e req-66e05090-1824-416b-b72d-784a542ee98c tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:56.179535 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-dff54963-072b-4b24-9fdf-af03820f573e req-66e05090-1824-416b-b72d-784a542ee98c tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.25 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.1602445 Jun 17 11:00:56.285745 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-949e96c1-ab9f-40a2-81b8-8bc79ca00737 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:56.355692 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-949e96c1-ab9f-40a2-81b8-8bc79ca00737 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:56.363115 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-56f12a8b-c6cf-424c-b21c-ccda0b07d0c5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:56.375243 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f37ba286-cdb8-4a18-ae9a-65ed6aa0509e req-5aab46b8-c62e-4a2f-ab0e-f5b9351247cc tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:56.377174 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f37ba286-cdb8-4a18-ae9a-65ed6aa0509e req-5aab46b8-c62e-4a2f-ab0e-f5b9351247cc tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 945 time: 0.1943226 Jun 17 11:00:56.448764 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-949e96c1-ab9f-40a2-81b8-8bc79ca00737 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=93321b7cf3d14ab5bdc50842bc54c3be&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6679254 Jun 17 11:00:56.453004 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33682) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:56.473679 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-949e96c1-ab9f-40a2-81b8-8bc79ca00737 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a2da171-fa3b-47cd-836e-8bb947a2d0a1,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:56.484910 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-949e96c1-ab9f-40a2-81b8-8bc79ca00737 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:56.498334 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f37ba286-cdb8-4a18-ae9a-65ed6aa0509e req-ee63de4f-2aee-4349-94fb-6deb623bb10b tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/security-groups?id=a32e6c4a-e4f9-4a92-a11f-19134c896927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991395 Jun 17 11:00:56.500918 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-dff54963-072b-4b24-9fdf-af03820f573e req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Deleting port 879bb19b-66f7-48e8-83ce-097684433ad0 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:00:56.501718 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-dff54963-072b-4b24-9fdf-af03820f573e req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:56.542453 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-36057507-3294-4c2d-8e77-a4e034d398f8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:56.571151 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-36057507-3294-4c2d-8e77-a4e034d398f8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:56.642549 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-dff54963-072b-4b24-9fdf-af03820f573e req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] For port 879bb19b-66f7-48e8-83ce-097684433ad0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=879bb19b-66f7-48e8-83ce-097684433ad0,segment=NetworkSegment(12145aeb-cad3-4041-a8a6-2c52a27c3eb7),segment_id=12145aeb-cad3-4041-a8a6-2c52a27c3eb7)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:00:56.643227 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-dff54963-072b-4b24-9fdf-af03820f573e req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:56.722188 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-36057507-3294-4c2d-8e77-a4e034d398f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:56.725070 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-36057507-3294-4c2d-8e77-a4e034d398f8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:56.726526 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-36057507-3294-4c2d-8e77-a4e034d398f8 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/1a2da171-fa3b-47cd-836e-8bb947a2d0a1 HTTP/1.1" status: 204 len: 168 time: 0.2721376 Jun 17 11:00:56.728210 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:56.744312 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36057507-3294-4c2d-8e77-a4e034d398f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a2da171-fa3b-47cd-836e-8bb947a2d0a1,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:56.754292 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-36057507-3294-4c2d-8e77-a4e034d398f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:56.759412 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-dff54963-072b-4b24-9fdf-af03820f573e req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Calling delete_port for 879bb19b-66f7-48e8-83ce-097684433ad0 owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:00:56.798060 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f96461a-c7d2-4e64-823a-4962522b827a req-4c546455-9bb0-4978-9060-0fc65a785fc2 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:56.800688 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8f96461a-c7d2-4e64-823a-4962522b827a req-4c546455-9bb0-4978-9060-0fc65a785fc2 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 944 time: 0.1169906 Jun 17 11:00:56.810186 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:56.847150 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8f96461a-c7d2-4e64-823a-4962522b827a req-e7b5245e-c941-48c2-bc1d-b614a4254006 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409107 Jun 17 11:00:56.940415 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33700) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:57.056244 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-dff54963-072b-4b24-9fdf-af03820f573e req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:57.061403 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:57.068393 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['879bb19b-66f7-48e8-83ce-097684433ad0'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:00:57.096331 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Pushing event deleted for resources: {'Port': ['ID=879bb19b-66f7-48e8-83ce-097684433ad0,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:57.100471 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:57.186953 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-dff54963-072b-4b24-9fdf-af03820f573e req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] No DVR routers for this DVR port 879bb19b-66f7-48e8-83ce-097684433ad0 on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:00:57.191401 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-dff54963-072b-4b24-9fdf-af03820f573e req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:57.194041 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-dff54963-072b-4b24-9fdf-af03820f573e req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.25 "DELETE /v2.0/ports/879bb19b-66f7-48e8-83ce-097684433ad0 HTTP/1.1" status: 204 len: 173 time: 1.0002124 Jun 17 11:00:57.194620 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf72262e-dfa5-4b03-b340-7b31fd5ecec6', 'name': 'network-vif-deleted', 'tag': '879bb19b-66f7-48e8-83ce-097684433ad0'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:00:57.199043 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96074df9-69e6-40f7-a06e-a1f1d4c322e7" -d '{"events": [{"server_uuid": "cf72262e-dfa5-4b03-b340-7b31fd5ecec6", "name": "network-vif-deleted", "tag": "879bb19b-66f7-48e8-83ce-097684433ad0"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:00:57.254230 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:00:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0edd8894-a24e-44c1-aaca-399eb0bfc283 x-openstack-request-id: req-0edd8894-a24e-44c1-aaca-399eb0bfc283 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:00:57.254691 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf72262e-dfa5-4b03-b340-7b31fd5ecec6", "name": "network-vif-deleted", "tag": "879bb19b-66f7-48e8-83ce-097684433ad0", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:00:57.255162 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-0edd8894-a24e-44c1-aaca-399eb0bfc283 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:00:57.255825 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf72262e-dfa5-4b03-b340-7b31fd5ecec6', 'name': 'network-vif-deleted', 'tag': '879bb19b-66f7-48e8-83ce-097684433ad0', 'status': 'completed', 'code': 200} Jun 17 11:00:57.336455 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-783fefd9-0408-43f6-97e4-6ce48667ecde admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:57.466617 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-783fefd9-0408-43f6-97e4-6ce48667ecde admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:57.507702 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-783fefd9-0408-43f6-97e4-6ce48667ecde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:57.511644 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-1624d2fa-ae1c-4f9f-92ef-3a5a2874cd25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:57.552868 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-783fefd9-0408-43f6-97e4-6ce48667ecde admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=02517e77668b454f8da14f8ee3d6a8ba&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6113076 Jun 17 11:00:57.555306 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33726) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:57.562742 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-783fefd9-0408-43f6-97e4-6ce48667ecde admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=157a35b5-505b-4620-a20e-de2cef3bcf37,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:57.572198 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-783fefd9-0408-43f6-97e4-6ce48667ecde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:57.613689 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214cd465-64b3-4eb6-9be6-4fcee35b127a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:57.645239 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214cd465-64b3-4eb6-9be6-4fcee35b127a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:57.721532 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1c0f730e-e901-4784-97a4-464a6a4ddfb6 req-8c83435d-d818-431b-8314-8703bccad44a tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] 10.222.0.41 "GET /v2.0/ports?device_id=cf72262e-dfa5-4b03-b340-7b31fd5ecec6 HTTP/1.1" status: 200 len: 210 time: 0.0386209 Jun 17 11:00:57.749624 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214cd465-64b3-4eb6-9be6-4fcee35b127a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:57.754289 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214cd465-64b3-4eb6-9be6-4fcee35b127a admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:57.756293 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-214cd465-64b3-4eb6-9be6-4fcee35b127a admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/157a35b5-505b-4620-a20e-de2cef3bcf37 HTTP/1.1" status: 204 len: 168 time: 0.1998174 Jun 17 11:00:57.757782 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:57.767970 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-214cd465-64b3-4eb6-9be6-4fcee35b127a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=157a35b5-505b-4620-a20e-de2cef3bcf37,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:57.771711 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-214cd465-64b3-4eb6-9be6-4fcee35b127a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:57.788935 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device b9d0052c-f650-4dae-8e30-09f806a67cfb up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:00:57.907507 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port b9d0052c-f650-4dae-8e30-09f806a67cfb completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:00:57.911720 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port b9d0052c-f650-4dae-8e30-09f806a67cfb triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:00:57.912244 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:58.035179 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:58.063755 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '994a1663-51bc-401a-969e-e74abbe386f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b9d0052c-f650-4dae-8e30-09f806a67cfb'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:00:58.066635 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62afa493-8605-4754-b59f-ae3cdd7ed42a" -d '{"events": [{"server_uuid": "994a1663-51bc-401a-969e-e74abbe386f5", "name": "network-vif-plugged", "status": "completed", "tag": "b9d0052c-f650-4dae-8e30-09f806a67cfb"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:00:58.084413 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port b9d0052c-f650-4dae-8e30-09f806a67cfb, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=b9d0052c-f650-4dae-8e30-09f806a67cfb,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:00:58.102625 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a281a732-906b-441b-a1cb-4b1b86e03548 req-53d80baf-39f4-4715-8f25-b2d42a2fb800 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:58.104161 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a281a732-906b-441b-a1cb-4b1b86e03548 req-53d80baf-39f4-4715-8f25-b2d42a2fb800 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 944 time: 0.0938592 Jun 17 11:00:58.141809 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:58.144788 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:58.163692 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a281a732-906b-441b-a1cb-4b1b86e03548 req-354b5bb6-c850-49bf-a4a1-fbe7985986de tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525670 Jun 17 11:00:58.212399 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=b9d0052c-f650-4dae-8e30-09f806a67cfb,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:58.212399 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:00:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dc75af66-7a9f-43f6-971d-cc7b19a4588a x-openstack-request-id: req-dc75af66-7a9f-43f6-971d-cc7b19a4588a {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:00:58.212399 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "994a1663-51bc-401a-969e-e74abbe386f5", "name": "network-vif-plugged", "status": "completed", "tag": "b9d0052c-f650-4dae-8e30-09f806a67cfb", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:00:58.212399 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-dc75af66-7a9f-43f6-971d-cc7b19a4588a {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:00:58.212399 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '994a1663-51bc-401a-969e-e74abbe386f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b9d0052c-f650-4dae-8e30-09f806a67cfb', 'code': 200} Jun 17 11:00:58.212399 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:58.587923 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33766) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:58.606204 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-46047514-44f3-46b3-81bd-57a7a2e3e03a admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:58.649372 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feda88dc-5be9-480f-b077-1291f208d53c req-b1eec263-5364-45bc-b733-fb22bab69a53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:58.651422 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-feda88dc-5be9-480f-b077-1291f208d53c req-b1eec263-5364-45bc-b733-fb22bab69a53 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 1098 time: 0.0863583 Jun 17 11:00:58.728256 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-feda88dc-5be9-480f-b077-1291f208d53c req-77f5fae1-588d-4599-94b1-f0bc5ae5c830 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694866 Jun 17 11:00:58.746654 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-46047514-44f3-46b3-81bd-57a7a2e3e03a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:58.810349 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-46047514-44f3-46b3-81bd-57a7a2e3e03a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:58.815057 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0aa77d59-fde2-40bb-9077-7e5db66cc509 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:58.894910 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-46047514-44f3-46b3-81bd-57a7a2e3e03a admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=729f140f71f94cc49c8258415b33b376&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3043332 Jun 17 11:00:58.896894 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33778) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:58.899504 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46047514-44f3-46b3-81bd-57a7a2e3e03a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a3a1f4f-2e9a-4762-b9f5-531142ab1a85,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:58.906328 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-46047514-44f3-46b3-81bd-57a7a2e3e03a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:58.969298 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-20553f6c-94ac-4fee-bcbc-1945b2136528 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:59.000399 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-20553f6c-94ac-4fee-bcbc-1945b2136528 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:59.119269 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-20553f6c-94ac-4fee-bcbc-1945b2136528 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:59.121995 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-20553f6c-94ac-4fee-bcbc-1945b2136528 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:59.123475 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33794) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:00:59.130143 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-20553f6c-94ac-4fee-bcbc-1945b2136528 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/2a3a1f4f-2e9a-4762-b9f5-531142ab1a85 HTTP/1.1" status: 204 len: 168 time: 0.2251961 Jun 17 11:00:59.130908 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-17ad01cc-4b95-4617-a515-7ca0acee6fdd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:59.138735 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20553f6c-94ac-4fee-bcbc-1945b2136528 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a3a1f4f-2e9a-4762-b9f5-531142ab1a85,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:00:59.176741 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-20553f6c-94ac-4fee-bcbc-1945b2136528 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:00:59.386979 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cb516f1-893a-48e4-b178-3d9a91fef59a req-f2ed81fc-b187-453c-9453-e4031fbe849a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:00:59.395043 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5cb516f1-893a-48e4-b178-3d9a91fef59a req-f2ed81fc-b187-453c-9453-e4031fbe849a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 945 time: 0.0924871 Jun 17 11:00:59.440114 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5cb516f1-893a-48e4-b178-3d9a91fef59a req-ed96ec37-1a24-4559-ac8e-9f22712f04da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433311 Jun 17 11:00:59.536853 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-16191241-network', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:00:59.628049 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Made reservation on behalf of 6c4c0226eef34f24a2c7072aba63129d for: {'network': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:00:59.630439 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:59.646431 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:59.756710 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:59.794537 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 879bb19b-66f7-48e8-83ce-097684433ad0 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:00:59.819009 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 879bb19b-66f7-48e8-83ce-097684433ad0 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:00:59.819366 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 879bb19b-66f7-48e8-83ce-097684433ad0 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:00:59.878821 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:59.883368 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9071c938-f90d-4d60-a132-fd712629f998 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:00:59.928679 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] vlan segment allocate from pool success with {'vlan_id': 137, 'physical_network': 'physnet1'} {{(pid=110214) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 11:00:59.941142 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:00:59.941819 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.segments_db [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Added segment 61eb1f0e-3387-4796-865e-caeb701082e6 of type vlan for network 16bcab5c-7033-4cca-98e1-b173b2d78c2f Jun 17 11:01:00.020058 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d8be6c1-6b50-4ccd-ac50-3296ffc1ea90,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:00.025414 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:00.035195 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:00.153674 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:00.155609 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:00.156203 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:00.159823 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-c10b5b40-1195-466d-a925-03c0ce69e242 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:00.248181 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Pushing event updated for resources: {'Network': ['ID=16bcab5c-7033-4cca-98e1-b173b2d78c2f,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:00.253666 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:00.261019 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 1.1321173 Jun 17 11:01:00.261019 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33850) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:00.261281 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network 16bcab5c-7033-4cca-98e1-b173b2d78c2f details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 11:01:00.266087 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Request body: {'subnet': {'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-16191241-subnet', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'ip_version': 4}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:00.394326 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Made reservation on behalf of 6c4c0226eef34f24a2c7072aba63129d for: {'subnet': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:01:00.395955 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5529992'] for subnet, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:00.759833 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee07f429-060b-4436-b326-20b62efcac4c req-b8d8a8f2-f9c5-4573-a6ad-d1b38f436216 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:00.761383 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ee07f429-060b-4436-b326-20b62efcac4c req-b8d8a8f2-f9c5-4573-a6ad-d1b38f436216 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 945 time: 0.1386089 Jun 17 11:01:00.763030 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6239242', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5530010'] for subnet, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:00.766547 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:00.786787 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33874) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:00.849999 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_v2 [None req-3fb579a0-554f-4d06-89bc-b799ae5fbdee admin admin] Deleting subnet 556ccdca-d712-410a-a954-c43564443811 {{(pid=110215) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:01:00.854302 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3fb579a0-554f-4d06-89bc-b799ae5fbdee admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:00.864817 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ee07f429-060b-4436-b326-20b62efcac4c req-9fb563e2-fa54-4e78-8ddf-4d5d2cc457b2 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934987 Jun 17 11:01:00.870354 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Checking segment: {'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110214) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:00.870711 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Network hostable DHCP agents. Network: 16bcab5c-7033-4cca-98e1-b173b2d78c2f, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110214) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 11:01:00.884244 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2567fd48-9bd6-4ffa-9d4c-72f989266554,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:00.899675 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:00.908463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3fb579a0-554f-4d06-89bc-b799ae5fbdee admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6032829'] for subnet, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:00.957152 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3fb579a0-554f-4d06-89bc-b799ae5fbdee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.021498 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Network 16bcab5c-7033-4cca-98e1-b173b2d78c2f is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110214) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 11:01:01.053825 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:01:01.125626 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, 16bcab5c-7033-4cca-98e1-b173b2d78c2f) {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:01.126016 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3fb579a0-554f-4d06-89bc-b799ae5fbdee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5898882', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5636066'] for subnet, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.131265 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4eb42f4c-c3a2-4e02-beca-5997c4ad8582 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:01.135385 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:01.136576 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c49c0c3b-5c7f-4f8c-acc5-143f45a3d62e None None] Network 16bcab5c-7033-4cca-98e1-b173b2d78c2f requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:01:01.137249 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.169217 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fb579a0-554f-4d06-89bc-b799ae5fbdee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=556ccdca-d712-410a-a954-c43564443811,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:01.174884 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3fb579a0-554f-4d06-89bc-b799ae5fbdee admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.181469 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-3fb579a0-554f-4d06-89bc-b799ae5fbdee admin admin] 10.222.0.41 "DELETE /v2.0/subnets/556ccdca-d712-410a-a954-c43564443811 HTTP/1.1" status: 204 len: 168 time: 0.3896649 Jun 17 11:01:01.181469 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3fb579a0-554f-4d06-89bc-b799ae5fbdee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:01.181469 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33882) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:01.290597 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 843 time: 1.0245974 Jun 17 11:01:01.291458 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 33888) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:01.297649 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:01.329469 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.348935 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5498e9f9-7e24-5c53-b771-9493a76e3e58-16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'fixed_ips': [{'subnet_id': '2567fd48-9bd6-4ffa-9d4c-72f989266554'}]}} from dv-cinder-773870-6-iscsi. {{(pid=110216) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Jun 17 11:01:01.349813 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.455218 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.457319 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8358582', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1816'] for router, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.458655 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8357919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8287158', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-8346348', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2019'] for router, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.470009 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e30545f7-6269-420b-a870-c56fe4fa7478']}} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:01.490415 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '12145aeb-cad3-4041-a8a6-2c52a27c3eb7') {'for_net_delete': True} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:01.491323 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '12145aeb-cad3-4041-a8a6-2c52a27c3eb7') {} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:01.506354 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6032818'] for segment, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.525678 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.533072 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] Releasing vlan 143 on physical network physnet1 to pool {{(pid=110215) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:01:01.534052 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5898799'] for segment, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: Traceback (most recent call last): Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: timer() Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: cb(*args, **kw) Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: return func(*args, **kwargs) Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: self._notify() Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: self.callback(batched_events) Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: event.method(event) Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: return f(self, *a, **k) Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._get(url).json() Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: return self.request(url, 'GET', **kwargs) Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:01:01.536454 dv-cinder-773870-6-iscsi neutron-server[110215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:01:01.657482 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.db_base_plugin_common [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Allocated IP 172.20.0.2 (16bcab5c-7033-4cca-98e1-b173b2d78c2f/2567fd48-9bd6-4ffa-9d4c-72f989266554/c84ed670-e254-4c75-8cc0-2207e5ad5322) {{(pid=110216) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:01:01.799845 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.807414 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.810434 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] 10.222.0.41 "DELETE /v2.0/networks/e30545f7-6269-420b-a870-c56fe4fa7478 HTTP/1.1" status: 204 len: 168 time: 0.6255267 Jun 17 11:01:01.812150 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3aa96736-3cba-46b7-9dda-03a4ca6c7a44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:01.850263 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:01.868333 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] Pushing event deleted for resources: {'Network': ['ID=e30545f7-6269-420b-a870-c56fe4fa7478,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:01.886606 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-587c33f3-cb50-4bfd-b5c0-a42d0224609a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:02.029605 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Notify callbacks [] for port, precommit_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.044800 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Transition to ACTIVE for port object c84ed670-e254-4c75-8cc0-2207e5ad5322 will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:02.063426 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Transition to ACTIVE for port object c84ed670-e254-4c75-8cc0-2207e5ad5322 will not be triggered until provisioned by entity DHCP. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:02.087204 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8287140', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8358552', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2037'] for router, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.178644 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.179299 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:02.214704 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Network 16bcab5c-7033-4cca-98e1-b173b2d78c2f is already hosted by enough agents. {{(pid=110216) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:02.217379 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.base_scheduler [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Resources bound (agent type, host, resource id): {{(pid=110216) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:02.226151 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Received port after_create {{(pid=110216) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:01:02.234011 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Pushing event updated for resources: {'Port': ['ID=c84ed670-e254-4c75-8cc0-2207e5ad5322,revision_number=1']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:02.261207 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:02.294532 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Attempting to bind port c84ed670-e254-4c75-8cc0-2207e5ad5322 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:01:02.295104 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Attempting to bind port c84ed670-e254-4c75-8cc0-2207e5ad5322 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:01:02.295460 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Attempting to bind port c84ed670-e254-4c75-8cc0-2207e5ad5322 on network 16bcab5c-7033-4cca-98e1-b173b2d78c2f {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:02.301467 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 0, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:01:02.302171 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Checking segment: {'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:02.303090 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.306016 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33928) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:02.306166 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Bound using segment: {'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:01:02.306570 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Bound port: c84ed670-e254-4c75-8cc0-2207e5ad5322, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:01:02.307014 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.353897 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-04c93d95-b7ff-460a-a027-fb915a07bf0b admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=95dd44ce5be843a295db7140aba1fb25&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0462680 Jun 17 11:01:02.357212 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33932) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:02.382652 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] For port c84ed670-e254-4c75-8cc0-2207e5ad5322, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:01:02.403613 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] For port c84ed670-e254-4c75-8cc0-2207e5ad5322, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=c84ed670-e254-4c75-8cc0-2207e5ad5322,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:01:02.409989 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c48f81b9-6565-4c79-ae38-14e77687bd3e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.447151 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c48f81b9-6565-4c79-ae38-14e77687bd3e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.477634 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.479369 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.486098 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:02.540774 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.566003 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Pushing event updated for resources: {'Port': ['ID=c84ed670-e254-4c75-8cc0-2207e5ad5322,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:02.569569 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:02.632775 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c48f81b9-6565-4c79-ae38-14e77687bd3e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.635551 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c48f81b9-6565-4c79-ae38-14e77687bd3e admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.643603 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-c48f81b9-6565-4c79-ae38-14e77687bd3e admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/a32e6c4a-e4f9-4a92-a11f-19134c896927 HTTP/1.1" status: 204 len: 168 time: 0.2841082 Jun 17 11:01:02.644955 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:02.659867 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c48f81b9-6565-4c79-ae38-14e77687bd3e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a32e6c4a-e4f9-4a92-a11f-19134c896927,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:02.664114 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c48f81b9-6565-4c79-ae38-14e77687bd3e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:02.679726 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Allocated IP 172.27.3.221 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/d8093fa7-53de-468d-b6bd-e7335e5adfa9) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:01:02.690614 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33940) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:02.834582 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.841198 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5820ca5e-1629-4fe2-8f63-1c06f2c4e0a5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.959050 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:02.962742 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:03.005905 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5820ca5e-1629-4fe2-8f63-1c06f2c4e0a5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:03.039023 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:03.042185 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:03.045220 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:01:03.079092 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Pushing event updated for resources: {'Port': ['ID=d8093fa7-53de-468d-b6bd-e7335e5adfa9,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:03.083176 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:03.090557 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5820ca5e-1629-4fe2-8f63-1c06f2c4e0a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:03.097022 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-de56a985-8d14-4a2b-8cc2-3a976364bea1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:03.159224 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-5820ca5e-1629-4fe2-8f63-1c06f2c4e0a5 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=7934314599e84f9aa89c5bc410d9ba62&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4663799 Jun 17 11:01:03.160154 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 33958) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:03.163594 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5820ca5e-1629-4fe2-8f63-1c06f2c4e0a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0354af2d-7a15-49a9-957f-a49fe65e5548,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:03.192502 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5820ca5e-1629-4fe2-8f63-1c06f2c4e0a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:03.254560 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-00d28a10-a95f-4562-92f8-163d313d582a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:03.281069 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-00d28a10-a95f-4562-92f8-163d313d582a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:03.411547 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-00d28a10-a95f-4562-92f8-163d313d582a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:03.414421 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-00d28a10-a95f-4562-92f8-163d313d582a admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:03.418139 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-00d28a10-a95f-4562-92f8-163d313d582a admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/0354af2d-7a15-49a9-957f-a49fe65e5548 HTTP/1.1" status: 204 len: 168 time: 0.2535293 Jun 17 11:01:03.418139 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-63e07dfd-ae84-4762-9701-f60d6e1eb777 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:03.430669 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00d28a10-a95f-4562-92f8-163d313d582a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0354af2d-7a15-49a9-957f-a49fe65e5548,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:03.450886 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-00d28a10-a95f-4562-92f8-163d313d582a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:03.496619 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:03.840272 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8358543', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8287186'] for router, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:03.990731 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b26c3703-f5ad-4ddf-8406-0df5e4a86d97 None None] Network 16bcab5c-7033-4cca-98e1-b173b2d78c2f requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:01:04.118362 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device c84ed670-e254-4c75-8cc0-2207e5ad5322 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:04.208548 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-e2eadf3d-fac2-4565-a0af-8280fffffe3d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:04.210029 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-e2eadf3d-fac2-4565-a0af-8280fffffe3d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 814 time: 0.2182982 Jun 17 11:01:04.228381 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-1e9b7bf8-b98b-4a30-b6ec-cb0e40a57ea8 None None] Provisioning for port c84ed670-e254-4c75-8cc0-2207e5ad5322 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:04.230323 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-1fa1f797-8f00-48a7-8fb7-735f4a14b2fa tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/quotas/5a3d5a50b1194ca594e398fd941cbe5f HTTP/1.1" status: 200 len: 375 time: 0.0107741 Jun 17 11:01:04.278715 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 is scheduled to L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 with binding_index 1 {{(pid=110214) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} Jun 17 11:01:04.437795 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port c84ed670-e254-4c75-8cc0-2207e5ad5322 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:04.449879 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:04.456993 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port c84ed670-e254-4c75-8cc0-2207e5ad5322 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:04.456993 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:04.457462 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34014) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:04.608574 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34022) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:04.610373 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-eb365bfa-9fe1-4d7a-94f0-4038a8425cb7 None None] Provisioning complete for port c84ed670-e254-4c75-8cc0-2207e5ad5322 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:04.611507 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-eb365bfa-9fe1-4d7a-94f0-4038a8425cb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:04.613480 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:04.638813 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-afcbd5cc-9d8e-4b95-8616-fdd5dcc73850 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:04.654723 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-network', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:04.667442 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-5f60f472-4116-49cf-b8a8-582aeb14f2ca tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&fields=id HTTP/1.1" status: 200 len: 302 time: 0.4309444 Jun 17 11:01:04.679271 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.db.api [None req-afcbd5cc-9d8e-4b95-8616-fdd5dcc73850 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Jun 17 11:01:04.679271 dv-cinder-773870-6-iscsi neutron-server[110215]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Jun 17 11:01:04.679271 dv-cinder-773870-6-iscsi neutron-server[110215]: [parameters: {'project_id_1': 'db0c9a68efac4bc4b29453229048cca5', 'expiration_1': datetime.datetime(2021, 6, 17, 11, 1, 4, 672007)}] Jun 17 11:01:04.679271 dv-cinder-773870-6-iscsi neutron-server[110215]: (Background on this error at: http://sqlalche.me/e/14/e3q8) {{(pid=110215) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Jun 17 11:01:04.680121 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_db.api [None req-afcbd5cc-9d8e-4b95-8616-fdd5dcc73850 admin admin] Performing DB retry for function neutron.db.securitygroups_db.SecurityGroupDbMixin.create_security_group {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jun 17 11:01:04.687299 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port c84ed670-e254-4c75-8cc0-2207e5ad5322, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=c84ed670-e254-4c75-8cc0-2207e5ad5322,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:04.716396 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:01:04.730067 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Sync routers for ids ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:01:04.737696 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-eb365bfa-9fe1-4d7a-94f0-4038a8425cb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:04.741476 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Routers {'08615a68-3696-4e03-8e4f-ea190d5c9ca6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:04.742098 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:00:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:04.782355 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Made reservation on behalf of e007b664c6c24e02a6dea83a17dd1f6b for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:01:04.783003 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:04.786975 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:04.787060 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:04.795632 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-2355872e-b7bf-47af-9db4-1617bbd0f6c1 service neutron] 10.222.0.41 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1084130 Jun 17 11:01:04.801355 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:04.856664 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Set router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:04.871994 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.db.api [None req-eb365bfa-9fe1-4d7a-94f0-4038a8425cb7 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110216) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Jun 17 11:01:04.872381 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_db.api [None req-eb365bfa-9fe1-4d7a-94f0-4038a8425cb7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jun 17 11:01:04.873638 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=c84ed670-e254-4c75-8cc0-2207e5ad5322,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:04.878227 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:04.886245 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Notify callbacks [] for router, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:04.890336 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] 10.222.0.41 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 3.5955415 Jun 17 11:01:04.892440 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34024) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:04.899422 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-7a4b3b9b-3f8b-4d91-aae7-094717cbfc3c service neutron] 10.222.0.41 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0968242 Jun 17 11:01:05.053318 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:03Z', 'revision_number': 3, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:05.082372 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Checking router: 08615a68-3696-4e03-8e4f-ea190d5c9ca6 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:01:05.082727 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Updating router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 port d8093fa7-53de-468d-b6bd-e7335e5adfa9 binding host dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:01:05.116631 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.182295 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.187345 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-afcbd5cc-9d8e-4b95-8616-fdd5dcc73850 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.260602 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0c4e45c3-bd6b-4f4c-a109-0bc20a85e3ed req-b4edcd59-f694-4f14-aa67-9bd5da6123a9 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 210 time: 0.0502157 Jun 17 11:01:05.308002 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.319979 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5820ca5e-1629-4fe2-8f63-1c06f2c4e0a5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:05.451740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2a6f543-62c5-454b-b738-e39aef4a6ff1,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:05.451740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=110215) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 11:01:05.497945 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:05.527182 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.527431 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Added segment 681b6bae-a040-4fca-ac88-d21e40353a83 of type vlan for network 0fe823e2-06dd-4212-84a6-8e0beda57580 Jun 17 11:01:05.539318 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Notify callbacks [] for port, precommit_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.551233 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.provisioning_blocks [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Transition to ACTIVE for port object d8093fa7-53de-468d-b6bd-e7335e5adfa9 will not be triggered until provisioned by entity L2. {{(pid=110218) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:05.610652 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.667566 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.678337 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:05.694925 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-afcbd5cc-9d8e-4b95-8616-fdd5dcc73850 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.726111 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Pushing event updated for resources: {'Port': ['ID=d8093fa7-53de-468d-b6bd-e7335e5adfa9,revision_number=2']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:05.738209 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.738817 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.738930 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.739218 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.739713 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.740033 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.740350 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.740662 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.740986 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.741441 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.741912 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.742228 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:05.757519 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Attempting to bind port d8093fa7-53de-468d-b6bd-e7335e5adfa9 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:01:05.757890 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Attempting to bind port d8093fa7-53de-468d-b6bd-e7335e5adfa9 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:01:05.758257 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Attempting to bind port d8093fa7-53de-468d-b6bd-e7335e5adfa9 on network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:05.761270 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:05.763927 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 0, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:01:05.764309 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Checking segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110218) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:05.764879 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.765287 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Bound using segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:01:05.765759 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Bound port: d8093fa7-53de-468d-b6bd-e7335e5adfa9, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:01:05.766257 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.803665 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.806907 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-afcbd5cc-9d8e-4b95-8616-fdd5dcc73850 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.809069 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.817127 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-89b7085b-ad23-4cce-954b-dbf3083e83bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:05.826066 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:05.826642 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.828173 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] For port d8093fa7-53de-468d-b6bd-e7335e5adfa9, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110218) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:01:05.832043 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] For port d8093fa7-53de-468d-b6bd-e7335e5adfa9, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=d8093fa7-53de-468d-b6bd-e7335e5adfa9,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110218) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:01:05.873232 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-afcbd5cc-9d8e-4b95-8616-fdd5dcc73850 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=db0c9a68efac4bc4b29453229048cca5&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2679548 Jun 17 11:01:05.875503 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afcbd5cc-9d8e-4b95-8616-fdd5dcc73850 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23998260-f713-4bb3-ac7a-9f22d7b46a41,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:05.876942 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34056) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:05.879769 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-afcbd5cc-9d8e-4b95-8616-fdd5dcc73850 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:05.882224 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.053s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:05.930649 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:05.947974 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:05.971372 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e7128c35-12df-47ab-9a4f-a462953730a0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:06.004519 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e7128c35-12df-47ab-9a4f-a462953730a0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:06.046045 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Routers {'08615a68-3696-4e03-8e4f-ea190d5c9ca6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:06.046771 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:00:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:06.048683 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device c84ed670-e254-4c75-8cc0-2207e5ad5322 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:06.123371 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Pushing event updated for resources: {'Port': ['ID=d8093fa7-53de-468d-b6bd-e7335e5adfa9,revision_number=3']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:06.129738 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:06.137529 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port c84ed670-e254-4c75-8cc0-2207e5ad5322 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:06.138093 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:06.176526 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] Set router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:06.187848 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e7128c35-12df-47ab-9a4f-a462953730a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:06.199137 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e7128c35-12df-47ab-9a4f-a462953730a0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:06.199137 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-e7128c35-12df-47ab-9a4f-a462953730a0 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/23998260-f713-4bb3-ac7a-9f22d7b46a41 HTTP/1.1" status: 204 len: 168 time: 0.3139689 Jun 17 11:01:06.199137 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:06.220148 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7128c35-12df-47ab-9a4f-a462953730a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23998260-f713-4bb3-ac7a-9f22d7b46a41,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:06.235273 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e7128c35-12df-47ab-9a4f-a462953730a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:06.279971 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 1.8230391 Jun 17 11:01:06.282983 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34068) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:06.288714 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Request body: {'subnet': {'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-subnet', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:06.412641 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Pushing event updated for resources: {'Network': ['ID=0fe823e2-06dd-4212-84a6-8e0beda57580,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:06.420418 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.537s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:06.424616 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Allocated IP 172.20.0.1 (16bcab5c-7033-4cca-98e1-b173b2d78c2f/2567fd48-9bd6-4ffa-9d4c-72f989266554/ae16d63a-186a-4b08-82b7-cde98ae2f1d5) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:01:06.431221 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network 0fe823e2-06dd-4212-84a6-8e0beda57580 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 11:01:06.438748 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Made reservation on behalf of e007b664c6c24e02a6dea83a17dd1f6b for: {'subnet': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:01:06.443553 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5529992'] for subnet, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:06.485511 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7acd02e7-7a22-4cf3-88d8-4abc5bbe5a54 req-748ca6c6-314d-411c-b1ea-c9111d96b8da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 210 time: 0.0479686 Jun 17 11:01:06.608044 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:03Z', 'revision_number': 3, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:06.609628 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:06.627754 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Transition to ACTIVE for port object ae16d63a-186a-4b08-82b7-cde98ae2f1d5 will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:06.642210 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da4067d8-ae75-4b40-8e97-fed1d30d0d45 None None] The sync data for ids ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'] in dv-cinder-773870-6-iscsi is: [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:03Z', 'revision_number': 3, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:01:06.776687 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:06.780658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:06.827656 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6239242', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5530010'] for subnet, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:06.828765 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Network 16bcab5c-7033-4cca-98e1-b173b2d78c2f is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:06.830426 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:06.832794 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:06.835313 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:01:06.885892 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Pushing event updated for resources: {'Port': ['ID=ae16d63a-186a-4b08-82b7-cde98ae2f1d5,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:06.888257 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Pushing event updated for resources: {'Subnet': ['ID=ab7c7a9f-b422-4b40-b94a-6939be91bbb8,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:06.897476 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:06.899583 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:06.917781 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Checking segment: {'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110214) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:06.918142 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Network hostable DHCP agents. Network: 0fe823e2-06dd-4212-84a6-8e0beda57580, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110214) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 11:01:06.929237 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8290659'] for router_interface, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:07.061821 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Network 0fe823e2-06dd-4212-84a6-8e0beda57580 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110214) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 11:01:07.150890 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, 0fe823e2-06dd-4212-84a6-8e0beda57580) {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:07.155573 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:07.156555 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:07.164396 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a61b65cf-d5b2-4c94-a359-eb073508b8c4 None None] Network 0fe823e2-06dd-4212-84a6-8e0beda57580 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:01:07.251650 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:07.279659 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.9952352 Jun 17 11:01:07.282804 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34100) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:07.287714 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-router', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:07.407930 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2394991f-dd2b-41b8-a9b9-a8e9a5ade3a0 None None] Network 0fe823e2-06dd-4212-84a6-8e0beda57580 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:01:07.465545 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-619a4b80-b3dd-4e16-86a0-4e10721ec242 None None] Provisioning for port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:07.473457 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:07.475029 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-619a4b80-b3dd-4e16-86a0-4e10721ec242 None None] Provisioning complete for port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:07.475410 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-619a4b80-b3dd-4e16-86a0-4e10721ec242 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:07.480081 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8358582', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1816'] for router, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:07.483423 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8357919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8287158', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-8346348', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2019'] for router, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:07.529946 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:07.534600 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3ac0089f-4dc2-4b37-a328-bbd6c2ac3623 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:07.569998 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-619a4b80-b3dd-4e16-86a0-4e10721ec242 None None] Port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:01:07.602724 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:07.623205 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Pushing event updated for resources: {'Port': ['ID=ae16d63a-186a-4b08-82b7-cde98ae2f1d5,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:07.627857 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:07.652708 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7899558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8290591'] for router_interface, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:07.779621 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3d2f656e-cc9e-4865-a4e7-db60c20b0adc req-1454f95a-6281-4255-a954-480659f75f14 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 210 time: 0.0408318 Jun 17 11:01:07.812786 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Network 16bcab5c-7033-4cca-98e1-b173b2d78c2f is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:07.815175 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:08.024216 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34118) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:08.041965 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8287140', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8358552', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2037'] for router, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.054031 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d8093fa7-53de-468d-b6bd-e7335e5adfa9 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:08.165808 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:01:08.195154 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-62eb9fdd-ac39-41c5-9551-a763a2c9eeb0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:08.196987 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-62eb9fdd-ac39-41c5-9551-a763a2c9eeb0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 814 time: 0.2012110 Jun 17 11:01:08.221698 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port d8093fa7-53de-468d-b6bd-e7335e5adfa9 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:08.227254 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port d8093fa7-53de-468d-b6bd-e7335e5adfa9 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:08.227791 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.303325 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Request body: {'port': {'device_id': 'd24ac987-0f9c-4315-a0ec-68765090caf9', 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b', 'admin_state_up': True, 'tenant_id': '5a3d5a50b1194ca594e398fd941cbe5f'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:08.325633 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-aa91fdb1-6259-4fbc-9c43-4a4f74ded356 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.340938 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-8ed8a919-8c64-4f1f-b886-8f2ae9b35662 None None] Provisioning complete for port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:08.342062 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8ed8a919-8c64-4f1f-b886-8f2ae9b35662 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.389682 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:01:08.395770 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] 10.222.0.41 "PUT /v2.0/routers/08615a68-3696-4e03-8e4f-ea190d5c9ca6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5015035 Jun 17 11:01:08.419584 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-8ed8a919-8c64-4f1f-b886-8f2ae9b35662 None None] Port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:01:08.515476 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.552325 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port d8093fa7-53de-468d-b6bd-e7335e5adfa9, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=d8093fa7-53de-468d-b6bd-e7335e5adfa9,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:08.580683 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.604269 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.606237 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:08.612363 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.696205 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-aa91fdb1-6259-4fbc-9c43-4a4f74ded356 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.704694 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=d8093fa7-53de-468d-b6bd-e7335e5adfa9,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:08.708278 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:08.758504 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Allocated IP 172.27.3.81 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/dd156b67-a7cb-4ed4-9492-a0178bd94cbe) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:01:08.786715 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-aa91fdb1-6259-4fbc-9c43-4a4f74ded356 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.792956 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:08.863734 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa91fdb1-6259-4fbc-9c43-4a4f74ded356 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=edc1aceb-6d63-4836-b15f-cf8ed855dddd,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:08.868815 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-aa91fdb1-6259-4fbc-9c43-4a4f74ded356 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:08.881516 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34156) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:08.882517 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-aa91fdb1-6259-4fbc-9c43-4a4f74ded356 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=833b4a9120d645aa9fc95043462f5fd8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8539219 Jun 17 11:01:08.908661 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Made reservation on behalf of 5a3d5a50b1194ca594e398fd941cbe5f for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:01:08.915783 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.926135 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:08.983915 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Sync routers for ids ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:01:09.000522 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Routers {'08615a68-3696-4e03-8e4f-ea190d5c9ca6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:09.001230 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:00:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:09.041696 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ce30280b-6256-4b48-a302-9beeb8a777a1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:09.075733 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ce30280b-6256-4b48-a302-9beeb8a777a1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:09.164786 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0df900b2-2a73-4aaf-82e9-49f144f79897 req-19983557-61a4-4c9d-97ca-6dfa40ee99ca tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 210 time: 0.1514430 Jun 17 11:01:09.212242 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Set router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:09.241007 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ce30280b-6256-4b48-a302-9beeb8a777a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:09.244012 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ce30280b-6256-4b48-a302-9beeb8a777a1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:09.245392 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-ce30280b-6256-4b48-a302-9beeb8a777a1 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/edc1aceb-6d63-4836-b15f-cf8ed855dddd HTTP/1.1" status: 204 len: 168 time: 0.3619182 Jun 17 11:01:09.246172 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-c3a67eee-dee9-4abe-9d7c-5e200cfa4ffc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:09.256411 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce30280b-6256-4b48-a302-9beeb8a777a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=edc1aceb-6d63-4836-b15f-cf8ed855dddd,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:09.262456 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-ce30280b-6256-4b48-a302-9beeb8a777a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:09.273731 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:09.279932 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:09.285375 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Allocated IP 172.20.0.3 (bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b/c10bc074-5591-4fbf-953f-e4097d48cc79/ab14f0f0-986e-47dd-a78c-224cbab21a85) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:01:09.376006 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:09.376006 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:09.376006 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:01:09.403249 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Pushing event updated for resources: {'Port': ['ID=dd156b67-a7cb-4ed4-9492-a0178bd94cbe,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:09.408727 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:09.519735 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:07Z', 'revision_number': 4, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'ae16d63a-186a-4b08-82b7-cde98ae2f1d5', 'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'mac_address': 'fa:16:3e:f6:74:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_interface', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:05Z', 'updated_at': '2021-06-17T11:01:07Z', 'revision_number': 2, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'subnets': [{'id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:09.535452 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:09.557493 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Checking router: 08615a68-3696-4e03-8e4f-ea190d5c9ca6 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:01:09.558315 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Updating router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 binding host dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:01:09.601022 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:09.677610 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:09.693738 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a048e92e-0ce4-4f97-b751-5ed2fae484ef tempest-DeleteServersTestJSON-1746319346 tempest-DeleteServersTestJSON-1746319346-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:09.740739 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5df2bc70-d7c4-4355-b3d7-81d2732dfd9d', 'b9d0052c-f650-4dae-8e30-09f806a67cfb'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:01:09.776774 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:09.782148 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:09.787102 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:01:09.847737 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Pushing event updated for resources: {'Port': ['ID=ab14f0f0-986e-47dd-a78c-224cbab21a85,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:09.855897 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:09.875037 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:09.875037 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:09.895521 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:09.965550 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6664078 Jun 17 11:01:09.979210 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Request body: {'port': {'device_id': 'd24ac987-0f9c-4315-a0ec-68765090caf9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:10.027726 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d8093fa7-53de-468d-b6bd-e7335e5adfa9 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:10.084073 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34188) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:10.093400 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1887644230-network', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:10.102730 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Notify callbacks [] for port, precommit_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.126786 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Transition to ACTIVE for port object ae16d63a-186a-4b08-82b7-cde98ae2f1d5 will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:10.140435 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.158816 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port d8093fa7-53de-468d-b6bd-e7335e5adfa9 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:10.159223 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.186925 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8358543', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8287186'] for router, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.210878 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.214308 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-b8b3ecc6-0ef7-4217-b4f2-6cde410fcfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:10.263479 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2658669d-fa3a-4438-a43a-6d5f5dcdd90c None None] Pushing event updated for resources: {'Port': ['ID=ae16d63a-186a-4b08-82b7-cde98ae2f1d5,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:10.271065 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2658669d-fa3a-4438-a43a-6d5f5dcdd90c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:10.317708 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Made reservation on behalf of 5b0bcf5e58ad4566ac164c2850ea7947 for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:01:10.320262 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.402437 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34200) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:10.410354 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.432995 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-de1bc256-cac8-4663-b089-17f0a8426f24 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.506780 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Attempting to bind port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:01:10.507266 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Attempting to bind port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:01:10.507555 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Attempting to bind port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 on network 16bcab5c-7033-4cca-98e1-b173b2d78c2f {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:10.513583 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 0, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:01:10.513970 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Checking segment: {'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:10.514380 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.514787 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Bound using segment: {'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:01:10.515301 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Bound port: ae16d63a-186a-4b08-82b7-cde98ae2f1d5, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:01:10.515682 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.616669 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] For port ae16d63a-186a-4b08-82b7-cde98ae2f1d5, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:01:10.624142 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Router 20434bf8-2076-49d9-bb15-5bae741fb5d9 is scheduled to L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 with binding_index 1 {{(pid=110214) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} Jun 17 11:01:10.624331 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] For port ae16d63a-186a-4b08-82b7-cde98ae2f1d5, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=ae16d63a-186a-4b08-82b7-cde98ae2f1d5,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:01:10.624448 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d1677e7-54b9-438d-8c36-d51cf059e7b2 req-23bec492-645f-4b0c-8a25-af87cf904781 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:10.625463 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0d1677e7-54b9-438d-8c36-d51cf059e7b2 req-23bec492-645f-4b0c-8a25-af87cf904781 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 931 time: 0.1642985 Jun 17 11:01:10.650264 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-de1bc256-cac8-4663-b089-17f0a8426f24 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.689251 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0d1677e7-54b9-438d-8c36-d51cf059e7b2 req-951be39d-75a3-43f1-b7c4-f63aab1c7549 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514534 Jun 17 11:01:10.714447 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.718709 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:10.735780 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ab14f0f0-986e-47dd-a78c-224cbab21a85 {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:01:10.749435 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.777505 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Transition to ACTIVE for port object ab14f0f0-986e-47dd-a78c-224cbab21a85 will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:10.787954 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2658669d-fa3a-4438-a43a-6d5f5dcdd90c None None] Pushing event updated for resources: {'Port': ['ID=ae16d63a-186a-4b08-82b7-cde98ae2f1d5,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:10.791256 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Routers {'08615a68-3696-4e03-8e4f-ea190d5c9ca6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:10.792006 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:00:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:10.794161 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2658669d-fa3a-4438-a43a-6d5f5dcdd90c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:10.858410 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:10.867545 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:10.983478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Pushing event updated for resources: {'Port': ['ID=ab14f0f0-986e-47dd-a78c-224cbab21a85,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:10.990879 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:10.995673 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.002496 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] Set router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:11.014604 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-de1bc256-cac8-4663-b089-17f0a8426f24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.033976 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d0d6c7b7-95ea-48d2-a65e-c0aa49ea725e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:11.070492 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.084984 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=110215) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 11:01:11.096555 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.097215 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Added segment fc102b61-79f9-42b1-a89b-28d6689dc41f of type vlan for network 4b6ea264-79c3-4ec1-8e3b-80abbb760608 Jun 17 11:01:11.098809 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-de1bc256-cac8-4663-b089-17f0a8426f24 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=8b40369ef3a94fbd90224ab04a6a3116&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6891420 Jun 17 11:01:11.103476 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34208) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:11.127634 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de1bc256-cac8-4663-b089-17f0a8426f24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc7db567-088b-4475-8436-e9e1c829a047,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:11.135663 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-de1bc256-cac8-4663-b089-17f0a8426f24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:11.148425 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.152620 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:01:11.162977 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Sync routers for ids ['20434bf8-2076-49d9-bb15-5bae741fb5d9'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:01:11.178724 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Routers {'20434bf8-2076-49d9-bb15-5bae741fb5d9'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:11.181565 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:00:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20434bf8-2076-49d9-bb15-5bae741fb5d9'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:11.208099 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e4a435d0-df70-4b0e-88e7-50b90b9dc089 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.218149 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-be3a9998-77bc-4c0a-8530-afadde238774 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:11.247285 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Notify callbacks [] for router, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.251324 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] 10.222.0.41 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 3.9643071 Jun 17 11:01:11.251846 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34214) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:11.284885 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bbcc31b4-116f-48ff-a757-ad5daae672a9,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:11.287981 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:11.289149 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Attempting to bind port ab14f0f0-986e-47dd-a78c-224cbab21a85 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:01:11.289478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Attempting to bind port ab14f0f0-986e-47dd-a78c-224cbab21a85 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:01:11.289800 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Attempting to bind port ab14f0f0-986e-47dd-a78c-224cbab21a85 on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:11.296937 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.296937 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:11.296937 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.300855 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:11.301434 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Port ab14f0f0-986e-47dd-a78c-224cbab21a85 on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:01:11.301770 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Attempting to bind port ab14f0f0-986e-47dd-a78c-224cbab21a85 on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:11.327839 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:01:11.328358 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Checking segment: {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:11.335697 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Bound using segment: {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:01:11.335697 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Bound port: ab14f0f0-986e-47dd-a78c-224cbab21a85, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:01:11.335697 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.349166 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e4a435d0-df70-4b0e-88e7-50b90b9dc089 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.368601 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Set router 20434bf8-2076-49d9-bb15-5bae741fb5d9 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:11.382436 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Pushing event updated for resources: {'Network': ['ID=4b6ea264-79c3-4ec1-8e3b-80abbb760608,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:11.385213 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:11.397222 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network 4b6ea264-79c3-4ec1-8e3b-80abbb760608 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 11:01:11.418363 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.3325891 Jun 17 11:01:11.424784 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34218) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:11.430395 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Request body: {'subnet': {'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1887644230-subnet', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'ip_version': 4}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:11.472260 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] For port ab14f0f0-986e-47dd-a78c-224cbab21a85, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:01:11.477244 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] For port ab14f0f0-986e-47dd-a78c-224cbab21a85, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=ab14f0f0-986e-47dd-a78c-224cbab21a85,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:01:11.530738 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Made reservation on behalf of 5b0bcf5e58ad4566ac164c2850ea7947 for: {'subnet': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:01:11.534262 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5636039'] for subnet, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.592717 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.617804 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e4a435d0-df70-4b0e-88e7-50b90b9dc089 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.620267 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-88d61d01-c273-408b-b208-1f2264da85d4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:11.620586 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e4a435d0-df70-4b0e-88e7-50b90b9dc089 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.633001 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-router', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81'}], 'enable_snat': True}, 'gw_port_id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:07Z', 'updated_at': '2021-06-17T11:01:09Z', 'revision_number': 3, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'gw_port': {'id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:d7:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 267, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:08Z', 'updated_at': '2021-06-17T11:01:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:11.638221 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:07Z', 'revision_number': 4, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'ae16d63a-186a-4b08-82b7-cde98ae2f1d5', 'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'mac_address': 'fa:16:3e:f6:74:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_interface', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:05Z', 'updated_at': '2021-06-17T11:01:10Z', 'revision_number': 4, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'subnets': [{'id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:11.639593 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-e4a435d0-df70-4b0e-88e7-50b90b9dc089 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/bc7db567-088b-4475-8436-e9e1c829a047 HTTP/1.1" status: 204 len: 168 time: 0.5215726 Jun 17 11:01:11.671812 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61909885-0ac1-47fa-a90b-d9b89721ecce None None] The sync data for ids ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'] in dv-cinder-773870-6-iscsi is: [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:07Z', 'revision_number': 4, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'ae16d63a-186a-4b08-82b7-cde98ae2f1d5', 'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'mac_address': 'fa:16:3e:f6:74:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_interface', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:05Z', 'updated_at': '2021-06-17T11:01:10Z', 'revision_number': 4, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'subnets': [{'id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:01:11.675167 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Checking router: 20434bf8-2076-49d9-bb15-5bae741fb5d9 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:01:11.675532 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Updating router 20434bf8-2076-49d9-bb15-5bae741fb5d9 port dd156b67-a7cb-4ed4-9492-a0178bd94cbe binding host dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:01:11.711565 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-89952f45-fd8d-4b88-8589-3cddc3ab7ca1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:11.725531 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.795279 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a435d0-df70-4b0e-88e7-50b90b9dc089 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc7db567-088b-4475-8436-e9e1c829a047,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:11.810512 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e4a435d0-df70-4b0e-88e7-50b90b9dc089 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:11.815909 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:11.821728 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:11.823999 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] 10.222.0.25 "PUT /v2.0/ports/ab14f0f0-986e-47dd-a78c-224cbab21a85 HTTP/1.1" status: 200 len: 1093 time: 1.8493216 Jun 17 11:01:11.843035 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd24ac987-0f9c-4315-a0ec-68765090caf9', 'tag': 'ab14f0f0-986e-47dd-a78c-224cbab21a85'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:01:11.851598 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4205270-fbb9-4c0e-a698-421cd995e1a3" -d '{"events": [{"name": "network-changed", "server_uuid": "d24ac987-0f9c-4315-a0ec-68765090caf9", "tag": "ab14f0f0-986e-47dd-a78c-224cbab21a85"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:01:11.995035 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:01:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6b29983-bb12-4acd-8ec6-fab5bd56893a x-openstack-request-id: req-c6b29983-bb12-4acd-8ec6-fab5bd56893a {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:01:11.995035 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d24ac987-0f9c-4315-a0ec-68765090caf9", "tag": "ab14f0f0-986e-47dd-a78c-224cbab21a85", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:01:11.995035 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-c6b29983-bb12-4acd-8ec6-fab5bd56893a {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:01:11.995035 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd24ac987-0f9c-4315-a0ec-68765090caf9', 'tag': 'ab14f0f0-986e-47dd-a78c-224cbab21a85', 'status': 'completed', 'code': 200} Jun 17 11:01:11.996377 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device ae16d63a-186a-4b08-82b7-cde98ae2f1d5 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:12.109918 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.156539 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Pushing event updated for resources: {'Port': ['ID=ab14f0f0-986e-47dd-a78c-224cbab21a85,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:12.164753 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.544s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:12.244311 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d67d715-4fbb-45b7-aad5-92c434f0d8f1 req-5cfcbca6-511b-4ec5-8c16-2787f80c6cb0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:12.246256 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4d67d715-4fbb-45b7-aad5-92c434f0d8f1 req-5cfcbca6-511b-4ec5-8c16-2787f80c6cb0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 943 time: 0.3468442 Jun 17 11:01:12.257850 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Notify callbacks [] for port, precommit_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.269519 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.provisioning_blocks [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Transition to ACTIVE for port object dd156b67-a7cb-4ed4-9492-a0178bd94cbe will not be triggered until provisioned by entity L2. {{(pid=110218) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:12.293521 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4205270-fbb9-4c0e-a698-421cd995e1a3 req-825f7b07-e7d1-471f-ac78-9cddbc81f3d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:12.295188 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a4205270-fbb9-4c0e-a698-421cd995e1a3 req-825f7b07-e7d1-471f-ac78-9cddbc81f3d2 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 1096 time: 0.2497306 Jun 17 11:01:12.321716 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Allocated IP 172.20.0.1 (0fe823e2-06dd-4212-84a6-8e0beda57580/ab7c7a9f-b422-4b40-b94a-6939be91bbb8/02e7db95-341e-4786-900e-6475e19dcf9f) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:01:12.329799 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4d67d715-4fbb-45b7-aad5-92c434f0d8f1 req-d2bbaa9a-f957-4cb9-82fe-83d2ec7f79ca tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750575 Jun 17 11:01:12.379006 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:12.386926 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:12.387395 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.399902 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5898957', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5636053'] for subnet, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.400115 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.408085 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-245f5212-441e-4ffe-bae2-4720e803f883 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:12.410086 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-23557d68-1ebc-4c4e-b726-84e457443a51 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:12.452135 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.535031 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Attempting to bind port dd156b67-a7cb-4ed4-9492-a0178bd94cbe on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:01:12.535403 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Attempting to bind port dd156b67-a7cb-4ed4-9492-a0178bd94cbe by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:01:12.535770 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Attempting to bind port dd156b67-a7cb-4ed4-9492-a0178bd94cbe on network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:12.548178 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 0, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:01:12.548613 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Checking segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110218) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:12.549037 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.549494 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Bound using segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:01:12.550020 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Bound port: dd156b67-a7cb-4ed4-9492-a0178bd94cbe, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:01:12.550400 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.552236 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67ed3eb6-504d-4578-b57c-6bf747a437f2 None None] Pushing event updated for resources: {'Port': ['ID=dd156b67-a7cb-4ed4-9492-a0178bd94cbe,revision_number=2']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:12.555544 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-67ed3eb6-504d-4578-b57c-6bf747a437f2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:12.579804 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.599829 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.603721 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:12.626600 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] For port dd156b67-a7cb-4ed4-9492-a0178bd94cbe, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110218) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:01:12.633141 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] For port dd156b67-a7cb-4ed4-9492-a0178bd94cbe, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=dd156b67-a7cb-4ed4-9492-a0178bd94cbe,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110218) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:01:12.642699 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port ae16d63a-186a-4b08-82b7-cde98ae2f1d5, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=ae16d63a-186a-4b08-82b7-cde98ae2f1d5,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:12.682703 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Pushing event updated for resources: {'Port': ['ID=02e7db95-341e-4786-900e-6475e19dcf9f,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:12.693767 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:12.703462 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Network 0fe823e2-06dd-4212-84a6-8e0beda57580 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:12.705103 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:12.707696 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:01:12.727405 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.730556 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:12.752891 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.755016 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:12.763576 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8290659'] for router_interface, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:12.831972 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Routers {'20434bf8-2076-49d9-bb15-5bae741fb5d9'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:12.832617 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:00:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20434bf8-2076-49d9-bb15-5bae741fb5d9'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:12.838060 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67ed3eb6-504d-4578-b57c-6bf747a437f2 None None] Pushing event updated for resources: {'Port': ['ID=dd156b67-a7cb-4ed4-9492-a0178bd94cbe,revision_number=3']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:12.853645 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=ae16d63a-186a-4b08-82b7-cde98ae2f1d5,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:12.865020 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:12.895274 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4205270-fbb9-4c0e-a698-421cd995e1a3 req-ae0fe123-9502-4e12-9f40-28cab33b70b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:12.896846 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a4205270-fbb9-4c0e-a698-421cd995e1a3 req-ae0fe123-9502-4e12-9f40-28cab33b70b8 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&shared=False HTTP/1.1" status: 200 len: 915 time: 0.5935135 Jun 17 11:01:12.913647 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=256f465c-ee93-4a3f-94ca-01e6c1e1c6be,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:12.927476 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.519s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:12.937600 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-67ed3eb6-504d-4578-b57c-6bf747a437f2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:12.944441 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Checking segment: {'id': 'fc102b61-79f9-42b1-a89b-28d6689dc41f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:12.944641 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Network hostable DHCP agents. Network: 4b6ea264-79c3-4ec1-8e3b-80abbb760608, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110215) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 11:01:13.023161 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] Set router 20434bf8-2076-49d9-bb15-5bae741fb5d9 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:13.037977 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4205270-fbb9-4c0e-a698-421cd995e1a3 req-4fe1c624-1361-403e-8e0e-850239b0983c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:13.040638 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a4205270-fbb9-4c0e-a698-421cd995e1a3 req-4fe1c624-1361-403e-8e0e-850239b0983c service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1269999 Jun 17 11:01:13.101594 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Network 4b6ea264-79c3-4ec1-8e3b-80abbb760608 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110215) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 11:01:13.174433 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:13.180232 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, 4b6ea264-79c3-4ec1-8e3b-80abbb760608) {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:13.189109 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f19b3b91-0884-448e-902b-a5fbcdf52924 None None] Network 4b6ea264-79c3-4ec1-8e3b-80abbb760608 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:01:13.202293 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:13.206557 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:13.224950 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-5281fea6-9e55-41f8-9480-be257e5b6d5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:13.225998 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-5281fea6-9e55-41f8-9480-be257e5b6d5c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 1096 time: 0.1169100 Jun 17 11:01:13.288780 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-c9062b03-1bfb-4abc-8d90-339e9a4a4491 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ab14f0f0-986e-47dd-a78c-224cbab21a85 HTTP/1.1" status: 200 len: 217 time: 0.0457320 Jun 17 11:01:13.328625 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-269b6727-d4e8-4a43-acec-62f16e7204a5 admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.8936694 Jun 17 11:01:13.337126 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34256) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:13.343846 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1887644230-router', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:13.371278 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-eb1a686f-ed22-4f53-a25b-d8372971dbeb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:13.377456 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-eb1a686f-ed22-4f53-a25b-d8372971dbeb service neutron] 10.222.0.25 "GET /v2.0/subnets?id=c10bc074-5591-4fbf-953f-e4097d48cc79 HTTP/1.1" status: 200 len: 854 time: 0.0785775 Jun 17 11:01:13.445076 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-5d5462d5-7be9-4702-a8d8-22ff6525da5e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0574880 Jun 17 11:01:13.520873 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5498e9f9-7e24-5c53-b771-9493a76e3e58-4b6ea264-79c3-4ec1-8e3b-80abbb760608', 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'fixed_ips': [{'subnet_id': '256f465c-ee93-4a3f-94ca-01e6c1e1c6be'}]}} from dv-cinder-773870-6-iscsi. {{(pid=110216) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Jun 17 11:01:13.521894 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:13.546028 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8358582', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1816'] for router, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:13.547254 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8357919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8287158', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-8346348', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2019'] for router, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:13.562762 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-router', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81'}], 'enable_snat': True}, 'gw_port_id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:07Z', 'updated_at': '2021-06-17T11:01:09Z', 'revision_number': 3, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'gw_port': {'id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:d7:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 267, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:08Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:13.582795 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:13.612670 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39ecd607-466f-49da-b55d-4702d610f91f None None] The sync data for ids ['20434bf8-2076-49d9-bb15-5bae741fb5d9'] in dv-cinder-773870-6-iscsi is: [{'id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-router', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81'}], 'enable_snat': True}, 'gw_port_id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:07Z', 'updated_at': '2021-06-17T11:01:09Z', 'revision_number': 3, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'gw_port': {'id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:d7:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 267, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:08Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:01:13.674153 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:13.678245 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:13.681860 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fc64fa53-11d7-48ce-9136-0bd52e520836 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:13.726376 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-d46dad6d-6395-4b9b-838c-7885ea60a2e2 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2702944 Jun 17 11:01:13.816920 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.db_base_plugin_common [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Allocated IP 172.20.0.2 (4b6ea264-79c3-4ec1-8e3b-80abbb760608/256f465c-ee93-4a3f-94ca-01e6c1e1c6be/28d54020-2e2c-4d89-8549-d0c51f50701f) {{(pid=110216) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:01:13.860760 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646abfb0-d1f3-4e27-9977-9ca50941041a req-3b0ba820-2d5a-4b87-9097-9d88b4656c57 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:13.869406 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-646abfb0-d1f3-4e27-9977-9ca50941041a req-3b0ba820-2d5a-4b87-9097-9d88b4656c57 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 943 time: 0.2440977 Jun 17 11:01:13.922897 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b4be5c5e-5486-40c7-ae5b-2b0cc3e9a7b0 req-3143ae42-bd07-4aa4-94a8-63011c3a2142 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1815193 Jun 17 11:01:13.928721 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7899558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8290591'] for router_interface, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:13.928721 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Pushing event updated for resources: {'Port': ['ID=02e7db95-341e-4786-900e-6475e19dcf9f,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:13.952882 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-646abfb0-d1f3-4e27-9977-9ca50941041a req-facca55c-71b2-478e-90ff-aa8207e260b7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809865 Jun 17 11:01:13.971326 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:14.129684 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8287140', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8358552', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2037'] for router, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:14.145817 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Notify callbacks [] for port, precommit_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:14.161869 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Transition to ACTIVE for port object 28d54020-2e2c-4d89-8549-d0c51f50701f will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:14.171774 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device ae16d63a-186a-4b08-82b7-cde98ae2f1d5 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:14.210501 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Network 0fe823e2-06dd-4212-84a6-8e0beda57580 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:14.212164 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:14.233281 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Transition to ACTIVE for port object 28d54020-2e2c-4d89-8549-d0c51f50701f will not be triggered until provisioned by entity DHCP. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:14.275581 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:14.276200 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:14.396855 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Router 20434bf8-2076-49d9-bb15-5bae741fb5d9 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:01:14.417065 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:14.423561 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:14.472151 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Network 4b6ea264-79c3-4ec1-8e3b-80abbb760608 is already hosted by enough agents. {{(pid=110216) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:14.475537 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.base_scheduler [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Resources bound (agent type, host, resource id): {{(pid=110216) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:14.478304 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Received port after_create {{(pid=110216) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:01:14.549645 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Pushing event updated for resources: {'Port': ['ID=28d54020-2e2c-4d89-8549-d0c51f50701f,revision_number=1']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:14.591883 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:14.602770 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Attempting to bind port 28d54020-2e2c-4d89-8549-d0c51f50701f on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:01:14.606681 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Attempting to bind port 28d54020-2e2c-4d89-8549-d0c51f50701f by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': 'fc102b61-79f9-42b1-a89b-28d6689dc41f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:01:14.606681 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Attempting to bind port 28d54020-2e2c-4d89-8549-d0c51f50701f on network 4b6ea264-79c3-4ec1-8e3b-80abbb760608 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:14.612629 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 0, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:01:14.613230 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Checking segment: {'id': 'fc102b61-79f9-42b1-a89b-28d6689dc41f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:14.613815 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:14.614375 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Bound using segment: {'id': 'fc102b61-79f9-42b1-a89b-28d6689dc41f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:01:14.615361 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Bound port: 28d54020-2e2c-4d89-8549-d0c51f50701f, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc102b61-79f9-42b1-a89b-28d6689dc41f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:01:14.615916 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:14.723919 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] For port 28d54020-2e2c-4d89-8549-d0c51f50701f, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:01:14.727634 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] For port 28d54020-2e2c-4d89-8549-d0c51f50701f, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=28d54020-2e2c-4d89-8549-d0c51f50701f,segment=NetworkSegment(fc102b61-79f9-42b1-a89b-28d6689dc41f),segment_id=fc102b61-79f9-42b1-a89b-28d6689dc41f)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:01:14.811165 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:14.816002 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:14.882939 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:01:14.888468 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] 10.222.0.41 "PUT /v2.0/routers/20434bf8-2076-49d9-bb15-5bae741fb5d9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6356013 Jun 17 11:01:14.904701 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Pushing event updated for resources: {'Port': ['ID=28d54020-2e2c-4d89-8549-d0c51f50701f,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:14.910145 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:15.126895 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:15.213818 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:15.265261 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bc783db-295f-4c99-b9ad-ded4a662e37e req-6c752a00-248d-4287-8269-8b825f3ad63f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:15.267693 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2bc783db-295f-4c99-b9ad-ded4a662e37e req-6c752a00-248d-4287-8269-8b825f3ad63f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 943 time: 0.1177626 Jun 17 11:01:15.386157 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Allocated IP 172.27.3.60 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/6473d52e-e7b4-43df-8dd9-77c7e6b7586c) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:01:15.392494 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2bc783db-295f-4c99-b9ad-ded4a662e37e req-6e470ae1-c9f8-49fc-9ae9-dbae99e3e40b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1189156 Jun 17 11:01:15.613259 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:15.822880 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:15.830677 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-13d760a6-04b1-439e-9089-a4783bd191de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:15.876491 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:15.889879 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:15.890017 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:01:15.929230 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-eb7ff573-11d1-4ac7-bdbe-bdb580d46152 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:15.930887 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-eb7ff573-11d1-4ac7-bdbe-bdb580d46152 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/networks?id=0fe823e2-06dd-4212-84a6-8e0beda57580 HTTP/1.1" status: 200 len: 819 time: 0.1848154 Jun 17 11:01:15.958488 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Pushing event updated for resources: {'Port': ['ID=6473d52e-e7b4-43df-8dd9-77c7e6b7586c,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:15.961663 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:15.985582 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-99ff66c0-10ad-487b-8235-ce4de2fee420 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/quotas/e007b664c6c24e02a6dea83a17dd1f6b HTTP/1.1" status: 200 len: 375 time: 0.0162363 Jun 17 11:01:16.046313 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 28d54020-2e2c-4d89-8549-d0c51f50701f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:16.190887 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-b6bd257c-f2a0-43a5-88df-1df923e88c2b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1997070 Jun 17 11:01:16.232419 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 28d54020-2e2c-4d89-8549-d0c51f50701f completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:16.237904 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device dd156b67-a7cb-4ed4-9492-a0178bd94cbe up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:16.250426 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34362) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:16.343445 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Sync routers for ids ['20434bf8-2076-49d9-bb15-5bae741fb5d9'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:01:16.365573 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Routers {'20434bf8-2076-49d9-bb15-5bae741fb5d9'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:16.366385 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:00:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20434bf8-2076-49d9-bb15-5bae741fb5d9'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:16.424352 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-996fc833-7ee4-45b0-aa7c-bab3c46b533d service neutron] 10.222.0.41 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2247083 Jun 17 11:01:16.455350 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port dd156b67-a7cb-4ed4-9492-a0178bd94cbe completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:16.464139 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port dd156b67-a7cb-4ed4-9492-a0178bd94cbe triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:16.464534 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:16.479761 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-04b936e2-9fbe-452a-83e1-51bb4d6aa62a admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:16.487251 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:16.559447 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Set router 20434bf8-2076-49d9-bb15-5bae741fb5d9 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:16.630835 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04bac066-0190-4fa0-93f6-9b65cb7cf304 None None] Network 4b6ea264-79c3-4ec1-8e3b-80abbb760608 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:01:16.701655 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-04b936e2-9fbe-452a-83e1-51bb4d6aa62a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:16.724622 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-ee4d2f7c-ad9a-4cc1-a391-2abd52e06616 service neutron] 10.222.0.41 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2928028 Jun 17 11:01:16.790585 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd59dd8-1266-4b4a-b13e-3a0ebcedf6e4 req-88a68f72-802a-4032-a8f0-432224062f36 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:16.799378 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bdd59dd8-1266-4b4a-b13e-3a0ebcedf6e4 req-88a68f72-802a-4032-a8f0-432224062f36 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 943 time: 0.1274629 Jun 17 11:01:16.810711 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-04b936e2-9fbe-452a-83e1-51bb4d6aa62a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:16.821009 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34380) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:16.823342 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ef3d647a-09c5-45b9-991f-8dbb6d413949 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:16.887785 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8358543', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8287186'] for router, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:16.924301 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-04b936e2-9fbe-452a-83e1-51bb4d6aa62a admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=f78c4ccc541d4d26adbc4c7145b29e2f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6723897 Jun 17 11:01:16.925287 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34384) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:16.927861 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04b936e2-9fbe-452a-83e1-51bb4d6aa62a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=debc07a8-93f5-4818-8c8a-0e640800bce7,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:16.954132 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bdd59dd8-1266-4b4a-b13e-3a0ebcedf6e4 req-d9afbd7f-ce02-471f-a330-d15e957fbd20 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1526897 Jun 17 11:01:16.955564 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-04b936e2-9fbe-452a-83e1-51bb4d6aa62a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:16.992910 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.005835 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-f8c41519-4d62-4811-b7b8-ee7c2cb2ba27 None None] Provisioning for port 28d54020-2e2c-4d89-8549-d0c51f50701f completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:17.032934 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-f8c41519-4d62-4811-b7b8-ee7c2cb2ba27 None None] Provisioning complete for port 28d54020-2e2c-4d89-8549-d0c51f50701f triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:17.033980 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f8c41519-4d62-4811-b7b8-ee7c2cb2ba27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.072187 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4bc0fdb5-e17f-420e-86e2-4955b58971bb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.089380 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port dd156b67-a7cb-4ed4-9492-a0178bd94cbe, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=dd156b67-a7cb-4ed4-9492-a0178bd94cbe,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:17.147994 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4bc0fdb5-e17f-420e-86e2-4955b58971bb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.185343 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.208761 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:17.226117 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2815844f-3e6d-4459-90fe-45abfc2011af req-538d2a0d-aba0-430a-a0d0-85e77fc2b52c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 210 time: 0.0641565 Jun 17 11:01:17.228992 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Router d1224a8c-31bd-435b-921a-53051bff5c2d is scheduled to L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 with binding_index 1 {{(pid=110214) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} Jun 17 11:01:17.248197 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bff7fa6d-c600-41c9-a6f6-2b62993b86ca admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.442775 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4bc0fdb5-e17f-420e-86e2-4955b58971bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.448456 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4bc0fdb5-e17f-420e-86e2-4955b58971bb admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.451170 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-4bc0fdb5-e17f-420e-86e2-4955b58971bb admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/debc07a8-93f5-4818-8c8a-0e640800bce7 HTTP/1.1" status: 204 len: 168 time: 0.5214531 Jun 17 11:01:17.467662 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=dd156b67-a7cb-4ed4-9492-a0178bd94cbe,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:17.469263 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-37c7d93a-51f4-4aa5-a86f-56076f961938 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:17.477040 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.284s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:17.486064 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f8c41519-4d62-4811-b7b8-ee7c2cb2ba27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.489963 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:01:17.505887 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bc0fdb5-e17f-420e-86e2-4955b58971bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=debc07a8-93f5-4818-8c8a-0e640800bce7,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:17.511608 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4bc0fdb5-e17f-420e-86e2-4955b58971bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:17.524308 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-router', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81'}], 'enable_snat': True}, 'gw_port_id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:07Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 4, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'gw_port': {'id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:d7:7e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 267, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:08Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '02e7db95-341e-4786-900e-6475e19dcf9f', 'name': '', 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'mac_address': 'fa:16:3e:af:93:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 283, 'fixed_ips': [{'subnet_id': 'ab7c7a9f-b422-4b40-b94a-6939be91bbb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:12Z', 'updated_at': '2021-06-17T11:01:13Z', 'revision_number': 2, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'subnets': [{'id': 'ab7c7a9f-b422-4b40-b94a-6939be91bbb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:17.532395 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Sync routers for ids ['d1224a8c-31bd-435b-921a-53051bff5c2d'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:01:17.552009 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Routers {'d1224a8c-31bd-435b-921a-53051bff5c2d'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:17.556565 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:00:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['d1224a8c-31bd-435b-921a-53051bff5c2d'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:17.587675 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Checking router: 20434bf8-2076-49d9-bb15-5bae741fb5d9 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:01:17.588426 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Updating router 20434bf8-2076-49d9-bb15-5bae741fb5d9 port 02e7db95-341e-4786-900e-6475e19dcf9f binding host dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:01:17.591612 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bff7fa6d-c600-41c9-a6f6-2b62993b86ca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.661654 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.684376 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bff7fa6d-c600-41c9-a6f6-2b62993b86ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.687084 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-34d4133b-dd0b-4d95-8814-1e8f065e66dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:17.702687 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-f8c41519-4d62-4811-b7b8-ee7c2cb2ba27 None None] For port 28d54020-2e2c-4d89-8549-d0c51f50701f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=28d54020-2e2c-4d89-8549-d0c51f50701f,segment=NetworkSegment(fc102b61-79f9-42b1-a89b-28d6689dc41f),segment_id=fc102b61-79f9-42b1-a89b-28d6689dc41f)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:17.746234 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-276b392b-9931-4b0b-a415-43fc4ce78a5f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:17.747854 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-276b392b-9931-4b0b-a415-43fc4ce78a5f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/networks?id=0fe823e2-06dd-4212-84a6-8e0beda57580 HTTP/1.1" status: 200 len: 819 time: 0.1702514 Jun 17 11:01:17.771214 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Notify callbacks [] for router, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.772633 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] 10.222.0.41 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 4.4341528 Jun 17 11:01:17.773598 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff7fa6d-c600-41c9-a6f6-2b62993b86ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88ce2cf9-a51d-4270-aadc-f01eae292d2a,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:17.775485 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34424) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:17.793261 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-bff7fa6d-c600-41c9-a6f6-2b62993b86ca admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=9a58e3051897484f8fb8f3346ef71358&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9670129 Jun 17 11:01:17.795370 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bff7fa6d-c600-41c9-a6f6-2b62993b86ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:17.796132 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34426) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:17.804764 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Set router d1224a8c-31bd-435b-921a-53051bff5c2d gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:17.888335 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device ab14f0f0-986e-47dd-a78c-224cbab21a85 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:01:17.902889 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f8c41519-4d62-4811-b7b8-ee7c2cb2ba27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:17.926720 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:17.931126 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-7b2069ab-8a6b-4343-bd84-71643f6f321a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.018877 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-7b2069ab-8a6b-4343-bd84-71643f6f321a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.074720 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device dd156b67-a7cb-4ed4-9492-a0178bd94cbe up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:18.120786 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.db.resource_extend [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Jun 17 11:01:18.171760 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8c41519-4d62-4811-b7b8-ee7c2cb2ba27 None None] Pushing event updated for resources: {'Port': ['ID=28d54020-2e2c-4d89-8549-d0c51f50701f,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:18.183837 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-846b7efd-1731-46d9-a062-93bb426883c2 None None] Provisioning complete for port 28d54020-2e2c-4d89-8549-d0c51f50701f triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:18.184442 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-846b7efd-1731-46d9-a062-93bb426883c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.186424 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-f8c41519-4d62-4811-b7b8-ee7c2cb2ba27 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.260s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:18.236694 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-592733f2-2065-43fd-acba-85b47dd609ab tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/quotas/e007b664c6c24e02a6dea83a17dd1f6b HTTP/1.1" status: 200 len: 375 time: 0.4819937 Jun 17 11:01:18.280098 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-7b2069ab-8a6b-4343-bd84-71643f6f321a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.293506 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-7b2069ab-8a6b-4343-bd84-71643f6f321a admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.298318 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-7b2069ab-8a6b-4343-bd84-71643f6f321a admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/88ce2cf9-a51d-4270-aadc-f01eae292d2a HTTP/1.1" status: 204 len: 168 time: 0.5008419 Jun 17 11:01:18.300637 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:18.320655 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b2069ab-8a6b-4343-bd84-71643f6f321a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88ce2cf9-a51d-4270-aadc-f01eae292d2a,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:18.346498 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7b2069ab-8a6b-4343-bd84-71643f6f321a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:18.364942 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'name': 'tempest-TestShelveInstance-1887644230-router', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:13Z', 'updated_at': '2021-06-17T11:01:16Z', 'revision_number': 3, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'gw_port': {'id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:d6:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:15Z', 'updated_at': '2021-06-17T11:01:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:18.386064 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port dd156b67-a7cb-4ed4-9492-a0178bd94cbe triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:18.386064 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.404010 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Checking router: d1224a8c-31bd-435b-921a-53051bff5c2d for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:01:18.404376 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Updating router d1224a8c-31bd-435b-921a-53051bff5c2d port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c binding host dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:01:18.449126 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b2cc70-1ea2-4ebc-87bd-eacaaed0a870 req-1b5c84d6-9306-4490-9b98-f186e83c0e46 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:18.453781 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-90b2cc70-1ea2-4ebc-87bd-eacaaed0a870 req-1b5c84d6-9306-4490-9b98-f186e83c0e46 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 943 time: 0.2743914 Jun 17 11:01:18.455606 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34446) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:18.468251 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.538391 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-90b2cc70-1ea2-4ebc-87bd-eacaaed0a870 req-75947465-fb88-4530-a538-0d75222c9e44 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552115 Jun 17 11:01:18.582541 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34450) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:18.607602 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-34380f70-8d41-47bc-a061-c0c4dde7fad8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.611477 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port ab14f0f0-986e-47dd-a78c-224cbab21a85, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=ab14f0f0-986e-47dd-a78c-224cbab21a85,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:18.682949 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': 'ab14f0f0-986e-47dd-a78c-224cbab21a85', 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b', 'port_id': 'ab14f0f0-986e-47dd-a78c-224cbab21a85', 'mac_address': 'fa:16:3e:e4:9c:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c10bc074-5591-4fbf-953f-e4097d48cc79', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:01:18.683475 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-d98bd20e-9689-4c17-a285-6f8d9418d1cf tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&fields=id HTTP/1.1" status: 200 len: 255 time: 0.4211462 Jun 17 11:01:18.772342 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-34380f70-8d41-47bc-a061-c0c4dde7fad8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.826087 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Notify callbacks [] for port, precommit_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.843124 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Transition to ACTIVE for port object 02e7db95-341e-4786-900e-6475e19dcf9f will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:18.844931 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-34380f70-8d41-47bc-a061-c0c4dde7fad8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.848126 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4ea24626-4e27-4af4-8190-4158d9b56944 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:18.934729 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.942027 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:18.949598 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-069bdaf6-677e-4efd-8977-4141c87da1a3 service neutron] 10.222.0.41 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2453563 Jun 17 11:01:18.967702 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-34380f70-8d41-47bc-a061-c0c4dde7fad8 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=f8bbacbdb3e3433fb22a2fc5ff60c294&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3759594 Jun 17 11:01:18.969850 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34380f70-8d41-47bc-a061-c0c4dde7fad8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed6bfd97-618b-4cf9-afb1-713262932d2e,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:18.971579 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34454) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:18.977138 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-34380f70-8d41-47bc-a061-c0c4dde7fad8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:18.980459 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:19.014798 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Notify callbacks [] for port, precommit_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.027209 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.provisioning_blocks [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Transition to ACTIVE for port object 6473d52e-e7b4-43df-8dd9-77c7e6b7586c will not be triggered until provisioned by entity L2. {{(pid=110218) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:19.047992 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4c4cebc8-44ed-44cc-8150-3cd0e215a1cd admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.100269 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ab14f0f0-986e-47dd-a78c-224cbab21a85 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:01:19.118009 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.122081 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:19.127713 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port ab14f0f0-986e-47dd-a78c-224cbab21a85, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=ab14f0f0-986e-47dd-a78c-224cbab21a85,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:19.128778 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d64879c-1103-4910-a230-1ee887b6c63d None None] Pushing event updated for resources: {'Port': ['ID=02e7db95-341e-4786-900e-6475e19dcf9f,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:19.131729 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6d64879c-1103-4910-a230-1ee887b6c63d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:19.201639 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4c4cebc8-44ed-44cc-8150-3cd0e215a1cd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.213429 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Attempting to bind port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:01:19.214590 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Attempting to bind port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:01:19.214590 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Attempting to bind port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c on network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:19.222878 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d731eab-1a04-4478-8ee2-7a2b1513e154 None None] Pushing event updated for resources: {'Port': ['ID=6473d52e-e7b4-43df-8dd9-77c7e6b7586c,revision_number=2']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:19.225689 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 0, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:01:19.226173 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Checking segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110218) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:19.226618 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.227204 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Bound using segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:01:19.227676 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Bound port: 6473d52e-e7b4-43df-8dd9-77c7e6b7586c, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:01:19.228133 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.229882 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Attempting to bind port 02e7db95-341e-4786-900e-6475e19dcf9f on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:01:19.230478 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Attempting to bind port 02e7db95-341e-4786-900e-6475e19dcf9f by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:01:19.230884 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-2d731eab-1a04-4478-8ee2-7a2b1513e154 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:19.231209 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Attempting to bind port 02e7db95-341e-4786-900e-6475e19dcf9f on network 0fe823e2-06dd-4212-84a6-8e0beda57580 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:19.236791 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 0, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:01:19.237787 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Checking segment: {'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:19.238214 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.238729 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Bound using segment: {'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:01:19.239365 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Bound port: 02e7db95-341e-4786-900e-6475e19dcf9f, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:01:19.239832 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.250053 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.255385 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f940d3b8-6f53-4cd9-9e20-a683de41ffa6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.255629 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:19.296392 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] For port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110218) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:01:19.298813 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6dd95f4f-e24a-4a83-863c-e239a423a936 service neutron] 10.222.0.41 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3443313 Jun 17 11:01:19.300900 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] For port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=6473d52e-e7b4-43df-8dd9-77c7e6b7586c,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110218) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:01:19.318272 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f940d3b8-6f53-4cd9-9e20-a683de41ffa6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.346555 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=ab14f0f0-986e-47dd-a78c-224cbab21a85,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:19.347947 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:19.361302 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] For port 02e7db95-341e-4786-900e-6475e19dcf9f, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:01:19.365083 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] For port 02e7db95-341e-4786-900e-6475e19dcf9f, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=02e7db95-341e-4786-900e-6475e19dcf9f,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:01:19.369476 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4c4cebc8-44ed-44cc-8150-3cd0e215a1cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.372849 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c48f81b9-6565-4c79-ae38-14e77687bd3e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:19.399243 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.402597 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:19.410882 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-4c4cebc8-44ed-44cc-8150-3cd0e215a1cd admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=2c83a128a6344db9a0b6a5c0bf6e7c46&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9536381 Jun 17 11:01:19.413849 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34462) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:19.444879 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c4cebc8-44ed-44cc-8150-3cd0e215a1cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8eef6718-a6a1-45a9-a574-58baa3218139,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:19.449303 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4c4cebc8-44ed-44cc-8150-3cd0e215a1cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:19.463366 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Routers {'d1224a8c-31bd-435b-921a-53051bff5c2d'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:19.464181 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:00:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['d1224a8c-31bd-435b-921a-53051bff5c2d'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:19.480915 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-abf9c30d-65bd-473f-ab98-89b4d26cb61f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.489863 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.493421 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-3422de72-5464-4d0c-b9e7-6e76ba6ad152 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:19.521089 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-abf9c30d-65bd-473f-ab98-89b4d26cb61f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.530873 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.595457 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f940d3b8-6f53-4cd9-9e20-a683de41ffa6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.595698 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Routers {'20434bf8-2076-49d9-bb15-5bae741fb5d9'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:19.600524 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:00:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20434bf8-2076-49d9-bb15-5bae741fb5d9'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:19.601117 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f940d3b8-6f53-4cd9-9e20-a683de41ffa6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.605747 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-f940d3b8-6f53-4cd9-9e20-a683de41ffa6 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/ed6bfd97-618b-4cf9-afb1-713262932d2e HTTP/1.1" status: 204 len: 168 time: 0.6108501 Jun 17 11:01:19.651627 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d731eab-1a04-4478-8ee2-7a2b1513e154 None None] Pushing event updated for resources: {'Port': ['ID=6473d52e-e7b4-43df-8dd9-77c7e6b7586c,revision_number=3']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:19.655253 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-2d731eab-1a04-4478-8ee2-7a2b1513e154 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:19.701323 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-abf9c30d-65bd-473f-ab98-89b4d26cb61f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.705816 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-abf9c30d-65bd-473f-ab98-89b4d26cb61f admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:19.713894 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-abf9c30d-65bd-473f-ab98-89b4d26cb61f admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/8eef6718-a6a1-45a9-a574-58baa3218139 HTTP/1.1" status: 204 len: 168 time: 0.2987533 Jun 17 11:01:19.715247 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['ab14f0f0-986e-47dd-a78c-224cbab21a85'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:01:19.716944 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7b2069ab-8a6b-4343-bd84-71643f6f321a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:19.733105 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] Set router d1224a8c-31bd-435b-921a-53051bff5c2d gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:19.753200 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abf9c30d-65bd-473f-ab98-89b4d26cb61f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8eef6718-a6a1-45a9-a574-58baa3218139,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:19.764095 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-abf9c30d-65bd-473f-ab98-89b4d26cb61f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:19.780903 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-214cd465-64b3-4eb6-9be6-4fcee35b127a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:19.863704 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f940d3b8-6f53-4cd9-9e20-a683de41ffa6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed6bfd97-618b-4cf9-afb1-713262932d2e,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:19.872547 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d1a3e69f-1d0b-4bf0-bdbf-83d3ae76aa68 req-4b970fcb-c66b-431e-adad-627202bdb2de tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 210 time: 0.0854454 Jun 17 11:01:19.877221 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f940d3b8-6f53-4cd9-9e20-a683de41ffa6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:19.940060 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d64879c-1103-4910-a230-1ee887b6c63d None None] Pushing event updated for resources: {'Port': ['ID=02e7db95-341e-4786-900e-6475e19dcf9f,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:19.950838 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6d64879c-1103-4910-a230-1ee887b6c63d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.456s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:20.071331 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a16636-e057-41d0-b3af-7f5d24422703 req-1370fdc5-e8dd-4627-97a7-701410c3e238 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:20.082235 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c4a16636-e057-41d0-b3af-7f5d24422703 req-1370fdc5-e8dd-4627-97a7-701410c3e238 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 944 time: 0.3045061 Jun 17 11:01:20.092030 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 28d54020-2e2c-4d89-8549-d0c51f50701f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:20.151211 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c4a16636-e057-41d0-b3af-7f5d24422703 req-21fc0a1c-e7fa-46b8-824d-2cbfefadf1f8 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0608542 Jun 17 11:01:20.151317 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'name': 'tempest-TestShelveInstance-1887644230-router', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:13Z', 'updated_at': '2021-06-17T11:01:16Z', 'revision_number': 3, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'gw_port': {'id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:d6:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:15Z', 'updated_at': '2021-06-17T11:01:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:20.172729 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Allocated IP 172.20.0.1 (4b6ea264-79c3-4ec1-8e3b-80abbb760608/256f465c-ee93-4a3f-94ca-01e6c1e1c6be/b77decc0-7ba4-46df-b003-b330aa03743f) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:01:20.203403 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-799db44e-40fc-4a42-b5f5-780c5194ca53 None None] The sync data for ids ['d1224a8c-31bd-435b-921a-53051bff5c2d'] in dv-cinder-773870-6-iscsi is: [{'id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'name': 'tempest-TestShelveInstance-1887644230-router', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:13Z', 'updated_at': '2021-06-17T11:01:16Z', 'revision_number': 3, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'gw_port': {'id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:d6:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:15Z', 'updated_at': '2021-06-17T11:01:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:01:20.215638 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] Set router 20434bf8-2076-49d9-bb15-5bae741fb5d9 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:20.401351 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:20.426258 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.provisioning_blocks [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Transition to ACTIVE for port object b77decc0-7ba4-46df-b003-b330aa03743f will not be triggered until provisioned by entity DHCP. {{(pid=110214) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:20.507969 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-f8559d07-2cb7-4893-b8c6-b9125f1fe406 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:20.509871 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-f8559d07-2cb7-4893-b8c6-b9125f1fe406 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.25 "GET /v2.0/networks?id=0fe823e2-06dd-4212-84a6-8e0beda57580 HTTP/1.1" status: 200 len: 819 time: 0.1819544 Jun 17 11:01:20.522526 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:20.527178 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Request body: {'port': {'device_id': 'a1113dd8-dbb2-4892-8625-6d6a3fdd1289', 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580', 'admin_state_up': True, 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:20.533226 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:20.672157 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Pushing event updated for resources: {'Port': ['ID=b77decc0-7ba4-46df-b003-b330aa03743f,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:20.709493 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:20.711210 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Network 4b6ea264-79c3-4ec1-8e3b-80abbb760608 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:20.712674 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:20.737013 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:01:20.812339 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8290659'] for router_interface, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:20.843836 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Made reservation on behalf of e007b664c6c24e02a6dea83a17dd1f6b for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:01:20.847041 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 28d54020-2e2c-4d89-8549-d0c51f50701f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:20.847959 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:20.852889 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:20.856160 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34514) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:20.898642 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-840d2f5e-1f92-447f-93d0-f60968c4f1ef admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:20.973130 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-27a01745-1fe7-4a98-9207-6386330631d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:21.023841 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34518) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:21.044673 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a9eb513-3b05-4529-894c-690eea3dfa37 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:21.170703 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Allocated IP 172.20.0.2 (0fe823e2-06dd-4212-84a6-8e0beda57580/ab7c7a9f-b422-4b40-b94a-6939be91bbb8/2ec3e896-70d1-4c47-933b-7234e4f744ed) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:01:21.195939 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-router', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81'}], 'enable_snat': True}, 'gw_port_id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:07Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 4, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'gw_port': {'id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:d7:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 267, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:08Z', 'updated_at': '2021-06-17T11:01:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '02e7db95-341e-4786-900e-6475e19dcf9f', 'name': '', 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'mac_address': 'fa:16:3e:af:93:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 283, 'fixed_ips': [{'subnet_id': 'ab7c7a9f-b422-4b40-b94a-6939be91bbb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:12Z', 'updated_at': '2021-06-17T11:01:19Z', 'revision_number': 4, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'subnets': [{'id': 'ab7c7a9f-b422-4b40-b94a-6939be91bbb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:21.251888 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d766c60f-de30-4a6f-b504-1917324da1e2 None None] The sync data for ids ['20434bf8-2076-49d9-bb15-5bae741fb5d9'] in dv-cinder-773870-6-iscsi is: [{'id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-router', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81'}], 'enable_snat': True}, 'gw_port_id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:07Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 4, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'gw_port': {'id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:d7:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 267, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:08Z', 'updated_at': '2021-06-17T11:01:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '02e7db95-341e-4786-900e-6475e19dcf9f', 'name': '', 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'mac_address': 'fa:16:3e:af:93:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 283, 'fixed_ips': [{'subnet_id': 'ab7c7a9f-b422-4b40-b94a-6939be91bbb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:12Z', 'updated_at': '2021-06-17T11:01:19Z', 'revision_number': 4, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'subnets': [{'id': 'ab7c7a9f-b422-4b40-b94a-6939be91bbb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:01:21.252639 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a9eb513-3b05-4529-894c-690eea3dfa37 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:21.308032 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:21.381012 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-f74f4250-bb6e-468f-b04e-60836546f527 None None] Provisioning for port b77decc0-7ba4-46df-b003-b330aa03743f completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:21.385214 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a9eb513-3b05-4529-894c-690eea3dfa37 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:21.385951 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-f74f4250-bb6e-468f-b04e-60836546f527 None None] Provisioning complete for port b77decc0-7ba4-46df-b003-b330aa03743f triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:21.398468 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f74f4250-bb6e-468f-b04e-60836546f527 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:21.429443 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5cf62a71-41e6-4745-be1c-6282c4abd8ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:21.443733 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-9a9eb513-3b05-4529-894c-690eea3dfa37 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=9bb22e3e6a8141d189bc4303a8c01df1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4183028 Jun 17 11:01:21.485190 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34532) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:21.518230 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2e448da9-70fd-4470-a8a9-8ee4ecebea01 req-d11e726e-4584-4a01-9970-56095616f778 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 210 time: 0.1572633 Jun 17 11:01:21.526940 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-f74f4250-bb6e-468f-b04e-60836546f527 None None] Port b77decc0-7ba4-46df-b003-b330aa03743f cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:01:21.616800 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a9eb513-3b05-4529-894c-690eea3dfa37 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d69a1d4a-282f-41ec-9d12-63f294a1939c,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:21.626448 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9a9eb513-3b05-4529-894c-690eea3dfa37 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:21.705328 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-040b2247-1240-4b88-aaab-05a9d2b51331 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:21.779232 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f74060-b073-4704-a8d4-3fcf62125a0c req-a04f0603-7a25-4eb4-a76d-bda993f35842 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:21.780888 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f2f74060-b073-4704-a8d4-3fcf62125a0c req-a04f0603-7a25-4eb4-a76d-bda993f35842 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 944 time: 0.3526392 Jun 17 11:01:21.830135 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:21.834393 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-040b2247-1240-4b88-aaab-05a9d2b51331 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:21.839704 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device ab14f0f0-986e-47dd-a78c-224cbab21a85 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:21.864706 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:21.919956 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f2f74060-b073-4704-a8d4-3fcf62125a0c req-f67ab540-de40-4cf9-a790-f2be54a9820d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0718021 Jun 17 11:01:21.946388 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.029462 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:22.061616 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port ab14f0f0-986e-47dd-a78c-224cbab21a85 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:22.067685 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port ab14f0f0-986e-47dd-a78c-224cbab21a85 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:22.068365 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.070195 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7899558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8290591'] for router_interface, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.109854 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-840d2f5e-1f92-447f-93d0-f60968c4f1ef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.111175 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Pushing event updated for resources: {'Port': ['ID=b77decc0-7ba4-46df-b003-b330aa03743f,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:22.120901 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-040b2247-1240-4b88-aaab-05a9d2b51331 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.123181 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:22.130726 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-040b2247-1240-4b88-aaab-05a9d2b51331 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.130726 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-040b2247-1240-4b88-aaab-05a9d2b51331 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/d69a1d4a-282f-41ec-9d12-63f294a1939c HTTP/1.1" status: 204 len: 168 time: 0.6371849 Jun 17 11:01:22.130726 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-00d28a10-a95f-4562-92f8-163d313d582a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:22.139944 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040b2247-1240-4b88-aaab-05a9d2b51331 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d69a1d4a-282f-41ec-9d12-63f294a1939c,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:22.153427 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-040b2247-1240-4b88-aaab-05a9d2b51331 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:22.155787 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.173457 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:22.199292 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-840d2f5e-1f92-447f-93d0-f60968c4f1ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.232887 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Network 4b6ea264-79c3-4ec1-8e3b-80abbb760608 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:22.234765 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:22.324132 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Network 0fe823e2-06dd-4212-84a6-8e0beda57580 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:22.332255 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 6473d52e-e7b4-43df-8dd9-77c7e6b7586c up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:22.346480 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:22.350974 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:01:22.427987 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Pushing event updated for resources: {'Port': ['ID=2ec3e896-70d1-4c47-933b-7234e4f744ed,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:22.443149 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:22.453930 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bff7fa6d-c600-41c9-a6f6-2b62993b86ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.161s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:22.455875 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-840d2f5e-1f92-447f-93d0-f60968c4f1ef admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=3d3c95f55b1c4cf9be798a784b629de3&name=default HTTP/1.1" status: 200 len: 2979 time: 1.5969110 Jun 17 11:01:22.467099 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34548) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:22.474522 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Router d1224a8c-31bd-435b-921a-53051bff5c2d has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:01:22.490559 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.532844 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:22.533646 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.562074 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-840d2f5e-1f92-447f-93d0-f60968c4f1ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88ff4d83-8629-4207-8109-94ff7a704360,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:22.580607 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-840d2f5e-1f92-447f-93d0-f60968c4f1ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:22.587643 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd24ac987-0f9c-4315-a0ec-68765090caf9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ab14f0f0-986e-47dd-a78c-224cbab21a85'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:01:22.595511 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d93ffb9e-7fe1-4e61-9825-ca595c4346c5" -d '{"events": [{"server_uuid": "d24ac987-0f9c-4315-a0ec-68765090caf9", "name": "network-vif-plugged", "status": "completed", "tag": "ab14f0f0-986e-47dd-a78c-224cbab21a85"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:01:22.596131 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cb942c14-4285-49d3-b5e3-7b0a83e9c157 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.607020 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:22.628549 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cb942c14-4285-49d3-b5e3-7b0a83e9c157 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.696611 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1772091 Jun 17 11:01:22.700843 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port ab14f0f0-986e-47dd-a78c-224cbab21a85, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=ab14f0f0-986e-47dd-a78c-224cbab21a85,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:22.700843 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:01:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e68a728-9fb9-4b78-b445-3ac82a287337 x-openstack-request-id: req-2e68a728-9fb9-4b78-b445-3ac82a287337 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:01:22.700843 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d24ac987-0f9c-4315-a0ec-68765090caf9", "name": "network-vif-plugged", "status": "completed", "tag": "ab14f0f0-986e-47dd-a78c-224cbab21a85", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:01:22.700843 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-2e68a728-9fb9-4b78-b445-3ac82a287337 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:01:22.700843 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd24ac987-0f9c-4315-a0ec-68765090caf9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ab14f0f0-986e-47dd-a78c-224cbab21a85', 'code': 200} Jun 17 11:01:22.701329 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:22.701508 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.716327 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Request body: {'port': {'device_id': 'a1113dd8-dbb2-4892-8625-6d6a3fdd1289', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:22.755318 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-c079463b-288d-4700-bbfd-afc9fecbe49f None None] Provisioning complete for port b77decc0-7ba4-46df-b003-b330aa03743f triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:22.756051 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-c079463b-288d-4700-bbfd-afc9fecbe49f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.792144 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:01:22.820875 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] 10.222.0.41 "PUT /v2.0/routers/d1224a8c-31bd-435b-921a-53051bff5c2d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0434711 Jun 17 11:01:22.836851 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-c079463b-288d-4700-bbfd-afc9fecbe49f None None] Port b77decc0-7ba4-46df-b003-b330aa03743f cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:01:22.841123 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.843642 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:22.858893 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cb942c14-4285-49d3-b5e3-7b0a83e9c157 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.867791 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cb942c14-4285-49d3-b5e3-7b0a83e9c157 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:22.870190 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-cb942c14-4285-49d3-b5e3-7b0a83e9c157 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/88ff4d83-8629-4207-8109-94ff7a704360 HTTP/1.1" status: 204 len: 168 time: 0.4021361 Jun 17 11:01:22.931101 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-20553f6c-94ac-4fee-bcbc-1945b2136528 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:23.046547 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb942c14-4285-49d3-b5e3-7b0a83e9c157 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88ff4d83-8629-4207-8109-94ff7a704360,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:23.065428 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cb942c14-4285-49d3-b5e3-7b0a83e9c157 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:23.069606 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=ab14f0f0-986e-47dd-a78c-224cbab21a85,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:23.085699 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:23.090040 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e7d97acf-1edf-4d9c-a924-992c79c4157f req-1e258c22-2b28-4532-a427-104638077554 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 210 time: 0.1784954 Jun 17 11:01:23.093436 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.106368 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.205867 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=6473d52e-e7b4-43df-8dd9-77c7e6b7586c,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:23.237344 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-43c9a1b4-330d-4561-a441-1d37ecc2fd08 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:23.238880 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-43c9a1b4-330d-4561-a441-1d37ecc2fd08 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.25 "GET /v2.0/networks?id=0fe823e2-06dd-4212-84a6-8e0beda57580 HTTP/1.1" status: 200 len: 819 time: 0.2270522 Jun 17 11:01:23.256437 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Request body: {'port': {'device_id': 'a4b6a250-cbe9-4e83-88f3-7dfe006deb6b', 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580', 'admin_state_up': True, 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:23.285879 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.285879 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 02e7db95-341e-4786-900e-6475e19dcf9f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:23.287255 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:23.383257 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-ab8b99ca-9fdc-49ef-96a1-b0fc8424e21d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.411029 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34582) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:23.449282 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=6473d52e-e7b4-43df-8dd9-77c7e6b7586c,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:23.453715 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:23.546975 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Made reservation on behalf of e007b664c6c24e02a6dea83a17dd1f6b for: {'port': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:01:23.547512 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 02e7db95-341e-4786-900e-6475e19dcf9f completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:23.551503 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.552953 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 02e7db95-341e-4786-900e-6475e19dcf9f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:23.553472 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.574608 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3695a2bf-f31d-490e-9b7d-ef4335a663a5 req-089041a5-e906-4f62-bd0b-f4f6a3b11d91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:23.577053 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3695a2bf-f31d-490e-9b7d-ef4335a663a5 req-089041a5-e906-4f62-bd0b-f4f6a3b11d91 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 1098 time: 0.3748388 Jun 17 11:01:23.591768 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.618778 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb90be9-d2d0-406c-a39a-b3635ed32a80 req-924cb136-c083-4241-ac7a-001a55f3c748 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:23.626382 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fbb90be9-d2d0-406c-a39a-b3635ed32a80 req-924cb136-c083-4241-ac7a-001a55f3c748 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 945 time: 0.2113066 Jun 17 11:01:23.706290 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.710770 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3695a2bf-f31d-490e-9b7d-ef4335a663a5 req-8a329ee5-0085-40df-8ec4-a7d86d8e2ed0 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1244392 Jun 17 11:01:23.765315 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 02e7db95-341e-4786-900e-6475e19dcf9f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=02e7db95-341e-4786-900e-6475e19dcf9f,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:23.797292 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fbb90be9-d2d0-406c-a39a-b3635ed32a80 req-0969af94-a6ae-4a56-8eec-fe15f670ce7a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1695917 Jun 17 11:01:23.817013 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2ec3e896-70d1-4c47-933b-7234e4f744ed {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:01:23.826687 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.837724 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.839863 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Transition to ACTIVE for port object 2ec3e896-70d1-4c47-933b-7234e4f744ed will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:23.841278 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:23.898279 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-df6186a3-efdb-4aa8-ba80-0064115998c8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.935302 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=02e7db95-341e-4786-900e-6475e19dcf9f,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:23.939075 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:23.941112 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:23.944047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:24.020760 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 6473d52e-e7b4-43df-8dd9-77c7e6b7586c up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:24.098475 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Pushing event updated for resources: {'Port': ['ID=2ec3e896-70d1-4c47-933b-7234e4f744ed,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:24.102541 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Allocated IP 172.20.0.3 (0fe823e2-06dd-4212-84a6-8e0beda57580/ab7c7a9f-b422-4b40-b94a-6939be91bbb8/f47e3e1a-e4f2-4b14-b64a-a67d84ad7677) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:01:24.103420 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:24.165485 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:24.165485 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:24.271845 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Sync routers for ids ['d1224a8c-31bd-435b-921a-53051bff5c2d'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:01:24.292626 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Routers {'d1224a8c-31bd-435b-921a-53051bff5c2d'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:24.293274 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:01:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['d1224a8c-31bd-435b-921a-53051bff5c2d'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:24.310155 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Attempting to bind port 2ec3e896-70d1-4c47-933b-7234e4f744ed on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:01:24.310569 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Attempting to bind port 2ec3e896-70d1-4c47-933b-7234e4f744ed by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:01:24.311093 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Attempting to bind port 2ec3e896-70d1-4c47-933b-7234e4f744ed on network 0fe823e2-06dd-4212-84a6-8e0beda57580 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:24.316627 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Port 2ec3e896-70d1-4c47-933b-7234e4f744ed on network 0fe823e2-06dd-4212-84a6-8e0beda57580 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:01:24.317041 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Attempting to bind port 2ec3e896-70d1-4c47-933b-7234e4f744ed on network 0fe823e2-06dd-4212-84a6-8e0beda57580 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:24.323461 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:01:24.323787 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Checking segment: {'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:24.324328 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Bound using segment: {'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:01:24.324912 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Bound port: 2ec3e896-70d1-4c47-933b-7234e4f744ed, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:01:24.325497 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:24.436623 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-18e20137-0bf6-431d-8e96-b7b8315d4ea0 req-3f15e907-c2f8-4b9f-a131-8b10ec7a4b93 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 210 time: 0.1003501 Jun 17 11:01:24.437347 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34608) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:24.456739 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-af97a421-b3d1-4391-82d4-fbfa408e5339 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1323394398', 'description': 'tempest-secgroup-smoke-1323394398 description', 'project_id': '6c4c0226eef34f24a2c7072aba63129d'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:24.498559 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Set router d1224a8c-31bd-435b-921a-53051bff5c2d gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:24.544111 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] For port 2ec3e896-70d1-4c47-933b-7234e4f744ed, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:01:24.551309 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] For port 2ec3e896-70d1-4c47-933b-7234e4f744ed, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=2ec3e896-70d1-4c47-933b-7234e4f744ed,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:01:24.729533 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:24.732454 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:24.749680 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:24.778537 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:24.779596 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:24.780748 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] 10.222.0.25 "PUT /v2.0/ports/2ec3e896-70d1-4c47-933b-7234e4f744ed HTTP/1.1" status: 200 len: 1093 time: 2.0710063 Jun 17 11:01:24.781837 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a1113dd8-dbb2-4892-8625-6d6a3fdd1289', 'tag': '2ec3e896-70d1-4c47-933b-7234e4f744ed'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:01:24.784339 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82f15d2c-22b9-400e-a858-e56adc37c037" -d '{"events": [{"name": "network-changed", "server_uuid": "a1113dd8-dbb2-4892-8625-6d6a3fdd1289", "tag": "2ec3e896-70d1-4c47-933b-7234e4f744ed"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:01:24.840958 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-df6186a3-efdb-4aa8-ba80-0064115998c8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:24.847979 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:24.853669 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Pushing event updated for resources: {'Port': ['ID=2ec3e896-70d1-4c47-933b-7234e4f744ed,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:24.867949 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:24.894289 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'name': 'tempest-TestShelveInstance-1887644230-router', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:13Z', 'updated_at': '2021-06-17T11:01:20Z', 'revision_number': 4, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'gw_port': {'id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:d6:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:15Z', 'updated_at': '2021-06-17T11:01:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'b77decc0-7ba4-46df-b003-b330aa03743f', 'name': '', 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'mac_address': 'fa:16:3e:04:62:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'device_owner': 'network:router_interface', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '256f465c-ee93-4a3f-94ca-01e6c1e1c6be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:19Z', 'updated_at': '2021-06-17T11:01:21Z', 'revision_number': 2, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'subnets': [{'id': '256f465c-ee93-4a3f-94ca-01e6c1e1c6be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:24.895973 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:01:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3bcd2f1-7346-498f-a398-edf2b1ec6adc x-openstack-request-id: req-d3bcd2f1-7346-498f-a398-edf2b1ec6adc {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:01:24.896409 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a1113dd8-dbb2-4892-8625-6d6a3fdd1289", "tag": "2ec3e896-70d1-4c47-933b-7234e4f744ed", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:01:24.897954 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-d3bcd2f1-7346-498f-a398-edf2b1ec6adc {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:01:24.897954 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a1113dd8-dbb2-4892-8625-6d6a3fdd1289', 'tag': '2ec3e896-70d1-4c47-933b-7234e4f744ed', 'status': 'completed', 'code': 200} Jun 17 11:01:24.947457 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Checking router: d1224a8c-31bd-435b-921a-53051bff5c2d for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:01:24.948791 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Updating router d1224a8c-31bd-435b-921a-53051bff5c2d port b77decc0-7ba4-46df-b003-b330aa03743f binding host dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:01:25.047129 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-df6186a3-efdb-4aa8-ba80-0064115998c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.052232 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82f15d2c-22b9-400e-a858-e56adc37c037 req-3ae7fbef-64b7-4d56-8627-527936c9ef43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:25.061638 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-82f15d2c-22b9-400e-a858-e56adc37c037 req-3ae7fbef-64b7-4d56-8627-527936c9ef43 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 1096 time: 0.1314778 Jun 17 11:01:25.100867 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.100981 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2d2c176f-2582-4bc4-9982-187addd75adb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:25.100981 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.175249 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-af97a421-b3d1-4391-82d4-fbfa408e5339 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.183766 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Network 0fe823e2-06dd-4212-84a6-8e0beda57580 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:01:25.192015 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:01:25.204897 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:01:25.231515 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-df6186a3-efdb-4aa8-ba80-0064115998c8 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=71feaa62958e4d20a3edde40f5d45cd3&name=default HTTP/1.1" status: 200 len: 2979 time: 1.8193114 Jun 17 11:01:25.234881 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34638) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:25.237708 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df6186a3-efdb-4aa8-ba80-0064115998c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32a80de3-54f2-4112-941f-1f52bec649ff,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:25.241557 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-df6186a3-efdb-4aa8-ba80-0064115998c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:25.271449 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.147s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:25.275835 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82f15d2c-22b9-400e-a858-e56adc37c037 req-ee672bc1-a0f9-4c89-9acc-57b613c48a8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:25.277548 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-82f15d2c-22b9-400e-a858-e56adc37c037 req-ee672bc1-a0f9-4c89-9acc-57b613c48a8b service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&shared=False HTTP/1.1" status: 200 len: 920 time: 0.2059519 Jun 17 11:01:25.371001 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Pushing event updated for resources: {'Port': ['ID=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:25.371001 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:25.378624 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:25.380387 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for port, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.393967 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35485a4a-b815-4f92-ab9d-cbfe8897add6 req-9cb07bdd-1aaa-421b-88c3-2db919630892 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:25.395525 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-35485a4a-b815-4f92-ab9d-cbfe8897add6 req-9cb07bdd-1aaa-421b-88c3-2db919630892 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 945 time: 0.4174223 Jun 17 11:01:25.396509 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Notify callbacks [] for port, precommit_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.412139 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Transition to ACTIVE for port object b77decc0-7ba4-46df-b003-b330aa03743f will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:25.450955 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bf375614-26aa-4241-a549-45f70c439fb9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.457368 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-35485a4a-b815-4f92-ab9d-cbfe8897add6 req-6c5d7245-2a3a-49de-a453-84ad80334392 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536175 Jun 17 11:01:25.474624 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-af97a421-b3d1-4391-82d4-fbfa408e5339 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.507221 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bf375614-26aa-4241-a549-45f70c439fb9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.511692 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.514124 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:25.516675 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82f15d2c-22b9-400e-a858-e56adc37c037 req-0a07268a-75e4-44a9-aed9-e773cf738c62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:25.518142 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-82f15d2c-22b9-400e-a858-e56adc37c037 req-0a07268a-75e4-44a9-aed9-e773cf738c62 service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2317522 Jun 17 11:01:25.541209 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-af97a421-b3d1-4391-82d4-fbfa408e5339 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.550470 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-949e96c1-ab9f-40a2-81b8-8bc79ca00737 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:25.586007 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a779021-0275-4c0a-81a6-da578148b5b3 None None] Pushing event updated for resources: {'Port': ['ID=b77decc0-7ba4-46df-b003-b330aa03743f,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:25.591738 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2a779021-0275-4c0a-81a6-da578148b5b3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:25.635564 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3816500 Jun 17 11:01:25.644504 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af97a421-b3d1-4391-82d4-fbfa408e5339 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bccb0152-196e-4e75-b2d0-57c36443b0bc,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:25.649964 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Request body: {'port': {'device_id': 'a4b6a250-cbe9-4e83-88f3-7dfe006deb6b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:25.696858 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-af97a421-b3d1-4391-82d4-fbfa408e5339 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:25.757144 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-af97a421-b3d1-4391-82d4-fbfa408e5339 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.759745 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-af97a421-b3d1-4391-82d4-fbfa408e5339 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 1.3186021 Jun 17 11:01:25.767227 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34654) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:25.772979 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.774004 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-63d1495d-fcfc-479a-9391-d67a7eecf131 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Request body: {'security_group_rule': {'security_group_id': 'bccb0152-196e-4e75-b2d0-57c36443b0bc', 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:25.799838 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Attempting to bind port b77decc0-7ba4-46df-b003-b330aa03743f on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:01:25.800423 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Attempting to bind port b77decc0-7ba4-46df-b003-b330aa03743f by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': 'fc102b61-79f9-42b1-a89b-28d6689dc41f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:01:25.801943 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Attempting to bind port b77decc0-7ba4-46df-b003-b330aa03743f on network 4b6ea264-79c3-4ec1-8e3b-80abbb760608 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:25.815568 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 1, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:01:25.819932 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Checking segment: {'id': 'fc102b61-79f9-42b1-a89b-28d6689dc41f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:25.819932 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.819932 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Bound using segment: {'id': 'fc102b61-79f9-42b1-a89b-28d6689dc41f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:01:25.819932 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Bound port: b77decc0-7ba4-46df-b003-b330aa03743f, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc102b61-79f9-42b1-a89b-28d6689dc41f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:01:25.819932 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.841574 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-562ca3e6-9d84-4a28-9535-64caa9100299 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:25.843349 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-562ca3e6-9d84-4a28-9535-64caa9100299 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 1096 time: 0.2641425 Jun 17 11:01:25.854273 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04239f13-0d95-4ece-99b6-4d50e9f89eb6 req-457058ae-c290-4df8-89cf-c68fa5cfae57 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:25.856713 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-04239f13-0d95-4ece-99b6-4d50e9f89eb6 req-457058ae-c290-4df8-89cf-c68fa5cfae57 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 931 time: 0.2166049 Jun 17 11:01:25.859745 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bf375614-26aa-4241-a549-45f70c439fb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.863896 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bf375614-26aa-4241-a549-45f70c439fb9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:25.865481 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-bf375614-26aa-4241-a549-45f70c439fb9 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/32a80de3-54f2-4112-941f-1f52bec649ff HTTP/1.1" status: 204 len: 168 time: 0.6279984 Jun 17 11:01:25.868282 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-abf9c30d-65bd-473f-ab98-89b4d26cb61f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:25.910391 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf375614-26aa-4241-a549-45f70c439fb9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32a80de3-54f2-4112-941f-1f52bec649ff,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:25.913688 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bf375614-26aa-4241-a549-45f70c439fb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:25.974111 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-04239f13-0d95-4ece-99b6-4d50e9f89eb6 req-986ce2ac-ba9c-47a4-8fe1-f2d7c5c2ec86 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1066670 Jun 17 11:01:25.995038 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63d1495d-fcfc-479a-9391-d67a7eecf131 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.046909 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] For port b77decc0-7ba4-46df-b003-b330aa03743f, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:01:26.054676 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] For port b77decc0-7ba4-46df-b003-b330aa03743f, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=b77decc0-7ba4-46df-b003-b330aa03743f,segment=NetworkSegment(fc102b61-79f9-42b1-a89b-28d6689dc41f),segment_id=fc102b61-79f9-42b1-a89b-28d6689dc41f)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:01:26.054676 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 02e7db95-341e-4786-900e-6475e19dcf9f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:26.084257 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63d1495d-fcfc-479a-9391-d67a7eecf131 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.121805 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 02e7db95-341e-4786-900e-6475e19dcf9f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:26.122292 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.133570 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 {{(pid=110214) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:01:26.141727 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.144450 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.148561 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:26.155088 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.provisioning_blocks [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Transition to ACTIVE for port object f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 will not be triggered until provisioned by entity L2. {{(pid=110214) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:01:26.192470 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63d1495d-fcfc-479a-9391-d67a7eecf131 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.195117 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:26.209624 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63d1495d-fcfc-479a-9391-d67a7eecf131 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8e539d42-f860-423f-96aa-16c819af11da,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:26.216815 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-63d1495d-fcfc-479a-9391-d67a7eecf131 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:26.234827 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a779021-0275-4c0a-81a6-da578148b5b3 None None] Pushing event updated for resources: {'Port': ['ID=b77decc0-7ba4-46df-b003-b330aa03743f,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:26.235564 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Routers {'d1224a8c-31bd-435b-921a-53051bff5c2d'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:01:26.236236 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:01:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['d1224a8c-31bd-435b-921a-53051bff5c2d'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:26.238198 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2a779021-0275-4c0a-81a6-da578148b5b3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:26.278367 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.282617 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:26.300906 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63d1495d-fcfc-479a-9391-d67a7eecf131 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.306247 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-63d1495d-fcfc-479a-9391-d67a7eecf131 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5366471 Jun 17 11:01:26.307451 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34668) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:26.313832 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-a2b44919-9136-4e8d-b1d0-2087642a62c9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Request body: {'security_group_rule': {'security_group_id': 'bccb0152-196e-4e75-b2d0-57c36443b0bc', 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:26.418196 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Pushing event updated for resources: {'Port': ['ID=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:26.421747 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:26.443988 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2b44919-9136-4e8d-b1d0-2087642a62c9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.531912 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] Set router d1224a8c-31bd-435b-921a-53051bff5c2d gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:01:26.542773 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2b44919-9136-4e8d-b1d0-2087642a62c9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.620798 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2b44919-9136-4e8d-b1d0-2087642a62c9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.626471 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-63d1495d-fcfc-479a-9391-d67a7eecf131 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:26.650380 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2b44919-9136-4e8d-b1d0-2087642a62c9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3edd569e-dbba-4a73-ace0-3fa32d12fbdb,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:26.653114 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a2b44919-9136-4e8d-b1d0-2087642a62c9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:26.711013 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14e25602-2fdd-416d-a1df-d1dadcfaf39a req-5d1d5141-bbf8-4b07-8446-30e12bb18d6e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:26.718010 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2b44919-9136-4e8d-b1d0-2087642a62c9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.719584 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-a2b44919-9136-4e8d-b1d0-2087642a62c9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4106047 Jun 17 11:01:26.722224 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34682) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:26.725407 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-14e25602-2fdd-416d-a1df-d1dadcfaf39a req-5d1d5141-bbf8-4b07-8446-30e12bb18d6e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 945 time: 0.1253452 Jun 17 11:01:26.731314 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-63a49d1d-0603-427b-8627-baf37fda04b9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Request body: {'security_group_rule': {'security_group_id': 'bccb0152-196e-4e75-b2d0-57c36443b0bc', 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:26.801384 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'name': 'tempest-TestShelveInstance-1887644230-router', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:13Z', 'updated_at': '2021-06-17T11:01:20Z', 'revision_number': 4, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'gw_port': {'id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:d6:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:15Z', 'updated_at': '2021-06-17T11:01:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'b77decc0-7ba4-46df-b003-b330aa03743f', 'name': '', 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'mac_address': 'fa:16:3e:04:62:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'device_owner': 'network:router_interface', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '256f465c-ee93-4a3f-94ca-01e6c1e1c6be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:19Z', 'updated_at': '2021-06-17T11:01:26Z', 'revision_number': 4, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'subnets': [{'id': '256f465c-ee93-4a3f-94ca-01e6c1e1c6be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:01:26.805239 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.845945 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b7d7223-4c2e-48ce-8473-83bf879364c9 None None] The sync data for ids ['d1224a8c-31bd-435b-921a-53051bff5c2d'] in dv-cinder-773870-6-iscsi is: [{'id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'name': 'tempest-TestShelveInstance-1887644230-router', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:13Z', 'updated_at': '2021-06-17T11:01:20Z', 'revision_number': 4, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'gw_port': {'id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:d6:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:15Z', 'updated_at': '2021-06-17T11:01:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'b77decc0-7ba4-46df-b003-b330aa03743f', 'name': '', 'network_id': '4b6ea264-79c3-4ec1-8e3b-80abbb760608', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'mac_address': 'fa:16:3e:04:62:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'device_owner': 'network:router_interface', 'standard_attr_id': 307, 'fixed_ips': [{'subnet_id': '256f465c-ee93-4a3f-94ca-01e6c1e1c6be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:19Z', 'updated_at': '2021-06-17T11:01:26Z', 'revision_number': 4, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'subnets': [{'id': '256f465c-ee93-4a3f-94ca-01e6c1e1c6be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:01:26.884392 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63a49d1d-0603-427b-8627-baf37fda04b9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:26.925856 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-14e25602-2fdd-416d-a1df-d1dadcfaf39a req-6bf58060-58d6-4085-bebc-335b1e7e1162 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1952069 Jun 17 11:01:26.960911 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.managers [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Attempting to bind port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:01:26.961769 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.managers [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Attempting to bind port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'}] {{(pid=110214) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:01:26.962188 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Attempting to bind port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 on network 0fe823e2-06dd-4212-84a6-8e0beda57580 {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:26.968061 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 on network 0fe823e2-06dd-4212-84a6-8e0beda57580 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:01:26.969158 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Attempting to bind port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 on network 0fe823e2-06dd-4212-84a6-8e0beda57580 {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:01:26.990333 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:01:26.991099 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Checking segment: {'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110214) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:01:26.991756 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Bound using segment: {'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'} {{(pid=110214) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:01:26.992461 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.managers [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Bound port: f47e3e1a-e4f2-4b14-b64a-a67d84ad7677, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '681b6bae-a040-4fca-ac88-d21e40353a83', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580'}}] {{(pid=110214) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:01:26.993011 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.033170 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63a49d1d-0603-427b-8627-baf37fda04b9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.118012 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63a49d1d-0603-427b-8627-baf37fda04b9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.123135 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] For port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677, host hv-cinder-77387, cleared binding levels {{(pid=110214) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:01:27.128483 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:27.129451 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] For port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110214) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:01:27.153748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63a49d1d-0603-427b-8627-baf37fda04b9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=54f0f201-603d-4433-8199-e0aa7117852c,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:27.163851 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-63a49d1d-0603-427b-8627-baf37fda04b9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:27.181435 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34700) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:27.228199 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6bf22c43-757e-4329-8cea-e35f8694e00d admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.245747 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.255187 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-54f57550-1c29-48c4-8792-868f3b9d0cad service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2ec3e896-70d1-4c47-933b-7234e4f744ed HTTP/1.1" status: 200 len: 217 time: 0.0562534 Jun 17 11:01:27.261030 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-63a49d1d-0603-427b-8627-baf37fda04b9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.271107 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-63a49d1d-0603-427b-8627-baf37fda04b9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5394561 Jun 17 11:01:27.271254 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:27.271354 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34706) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:27.273559 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-cb552a5d-fd1d-4859-af0f-38b45065a31d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Request body: {'security_group_rule': {'security_group_id': 'bccb0152-196e-4e75-b2d0-57c36443b0bc', 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:27.306945 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.db.api [None req-cb552a5d-fd1d-4859-af0f-38b45065a31d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Jun 17 11:01:27.306945 dv-cinder-773870-6-iscsi neutron-server[110215]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Jun 17 11:01:27.306945 dv-cinder-773870-6-iscsi neutron-server[110215]: [parameters: {'project_id_1': '6c4c0226eef34f24a2c7072aba63129d', 'expiration_1': datetime.datetime(2021, 6, 17, 11, 1, 27, 280479)}] Jun 17 11:01:27.306945 dv-cinder-773870-6-iscsi neutron-server[110215]: (Background on this error at: http://sqlalche.me/e/14/e3q8) {{(pid=110215) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Jun 17 11:01:27.307420 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_db.api [None req-cb552a5d-fd1d-4859-af0f-38b45065a31d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jun 17 11:01:27.337453 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:27.338069 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for port, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.339501 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] 10.222.0.25 "PUT /v2.0/ports/f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 HTTP/1.1" status: 200 len: 1093 time: 1.6938949 Jun 17 11:01:27.351375 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99fd3764-b3f1-4cc0-ae1c-5d759d9abee4 req-d9c4ea67-72cb-499a-86a3-bec912599efd tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:27.356205 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-99fd3764-b3f1-4cc0-ae1c-5d759d9abee4 req-d9c4ea67-72cb-499a-86a3-bec912599efd tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.1868238 Jun 17 11:01:27.357894 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a4b6a250-cbe9-4e83-88f3-7dfe006deb6b', 'tag': 'f47e3e1a-e4f2-4b14-b64a-a67d84ad7677'}] {{(pid=110214) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:01:27.360599 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cc2cf72888dbbd14a3b8c118b05d43e907687f619eecab2abc2da29781eba8b9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f064ec15-8e47-4420-95c5-0594f77b4757" -d '{"events": [{"name": "network-changed", "server_uuid": "a4b6a250-cbe9-4e83-88f3-7dfe006deb6b", "tag": "f47e3e1a-e4f2-4b14-b64a-a67d84ad7677"}]}' {{(pid=110214) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:01:27.397732 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Pushing event updated for resources: {'Port': ['ID=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677,revision_number=3']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:27.400710 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:27.435442 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-99fd3764-b3f1-4cc0-ae1c-5d759d9abee4 req-7ef3f05a-f378-4e40-9805-200a9e211322 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782752 Jun 17 11:01:27.488346 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:01:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3c962cff-b625-4f6d-9879-b73d133a90b0 x-openstack-request-id: req-3c962cff-b625-4f6d-9879-b73d133a90b0 {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:01:27.488776 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a4b6a250-cbe9-4e83-88f3-7dfe006deb6b", "tag": "f47e3e1a-e4f2-4b14-b64a-a67d84ad7677", "status": "completed", "code": 200}]} {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:01:27.489112 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-3c962cff-b625-4f6d-9879-b73d133a90b0 {{(pid=110214) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:01:27.489658 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a4b6a250-cbe9-4e83-88f3-7dfe006deb6b', 'tag': 'f47e3e1a-e4f2-4b14-b64a-a67d84ad7677', 'status': 'completed', 'code': 200} Jun 17 11:01:27.504274 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6bf22c43-757e-4329-8cea-e35f8694e00d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.597722 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6bf22c43-757e-4329-8cea-e35f8694e00d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.601101 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:27.643695 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-6bf22c43-757e-4329-8cea-e35f8694e00d admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=585093b018fd4e9d9b0876249c52628a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4559231 Jun 17 11:01:27.643695 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bf22c43-757e-4329-8cea-e35f8694e00d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c79e499e-4d61-475b-b414-5bb9b0bdf640,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:27.645163 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6bf22c43-757e-4329-8cea-e35f8694e00d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:27.645393 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34714) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:27.707041 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ea5f116d-1e71-4431-b02b-431e76181237 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.758695 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ea5f116d-1e71-4431-b02b-431e76181237 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.919257 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ea5f116d-1e71-4431-b02b-431e76181237 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.922731 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ea5f116d-1e71-4431-b02b-431e76181237 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:27.925666 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-ea5f116d-1e71-4431-b02b-431e76181237 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/c79e499e-4d61-475b-b414-5bb9b0bdf640 HTTP/1.1" status: 204 len: 168 time: 0.2766819 Jun 17 11:01:27.933889 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0df37b7e-d385-479a-a608-12359f6cdd4a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:27.935841 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5f116d-1e71-4431-b02b-431e76181237 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c79e499e-4d61-475b-b414-5bb9b0bdf640,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:27.938712 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ea5f116d-1e71-4431-b02b-431e76181237 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:27.985472 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cb552a5d-fd1d-4859-af0f-38b45065a31d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.023297 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device b77decc0-7ba4-46df-b003-b330aa03743f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:28.063791 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cb552a5d-fd1d-4859-af0f-38b45065a31d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.215041 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cb552a5d-fd1d-4859-af0f-38b45065a31d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.217066 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f40bdb72-4bfc-40c4-bad1-29e2b40ed1f7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:28.235555 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb552a5d-fd1d-4859-af0f-38b45065a31d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c277eed7-7199-4f4c-bb06-1c013e52084a,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:28.237949 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cb552a5d-fd1d-4859-af0f-38b45065a31d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:28.250137 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port b77decc0-7ba4-46df-b003-b330aa03743f completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:28.261329 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port b77decc0-7ba4-46df-b003-b330aa03743f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:28.261710 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.325478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cb552a5d-fd1d-4859-af0f-38b45065a31d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.329337 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-cb552a5d-fd1d-4859-af0f-38b45065a31d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.0590959 Jun 17 11:01:28.329579 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34720) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:28.334264 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-d033b1c0-68c7-4d9d-9316-e130772da434 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Request body: {'security_group_rule': {'security_group_id': 'bccb0152-196e-4e75-b2d0-57c36443b0bc', 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:28.352933 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.389270 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port b77decc0-7ba4-46df-b003-b330aa03743f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=b77decc0-7ba4-46df-b003-b330aa03743f,segment=NetworkSegment(fc102b61-79f9-42b1-a89b-28d6689dc41f),segment_id=fc102b61-79f9-42b1-a89b-28d6689dc41f)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:28.452585 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.securitygroups_db [None req-d033b1c0-68c7-4d9d-9316-e130772da434 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Project 6c4c0226eef34f24a2c7072aba63129d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jun 17 11:01:28.463601 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d033b1c0-68c7-4d9d-9316-e130772da434 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.468902 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.471164 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-f8c41519-4d62-4811-b7b8-ee7c2cb2ba27 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:28.573593 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=b77decc0-7ba4-46df-b003-b330aa03743f,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:28.585178 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:28.592662 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d033b1c0-68c7-4d9d-9316-e130772da434 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.679524 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f4156e1-dfe7-471d-ad46-f1acd719a0e6 req-960c3c8c-7398-4a49-aa14-8fd7161e2584 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:28.681431 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4f4156e1-dfe7-471d-ad46-f1acd719a0e6 req-960c3c8c-7398-4a49-aa14-8fd7161e2584 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0943742 Jun 17 11:01:28.721303 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4f4156e1-dfe7-471d-ad46-f1acd719a0e6 req-d26c5a43-eed0-480b-960c-8173c9e9bfda tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339780 Jun 17 11:01:28.729481 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d033b1c0-68c7-4d9d-9316-e130772da434 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.731221 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a2b44919-9136-4e8d-b1d0-2087642a62c9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:28.747720 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d033b1c0-68c7-4d9d-9316-e130772da434 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6b76adad-3efa-4672-b813-19d94cea3b36,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:28.751314 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d033b1c0-68c7-4d9d-9316-e130772da434 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:28.843658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d033b1c0-68c7-4d9d-9316-e130772da434 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.844866 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-d033b1c0-68c7-4d9d-9316-e130772da434 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.5143571 Jun 17 11:01:28.847625 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34738) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:28.852063 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-8c057801-a8c5-40af-84be-e895db7583a1 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Request body: {'security_group_rule': {'security_group_id': 'bccb0152-196e-4e75-b2d0-57c36443b0bc', 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:01:28.929387 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.securitygroups_db [None req-8c057801-a8c5-40af-84be-e895db7583a1 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Project 6c4c0226eef34f24a2c7072aba63129d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jun 17 11:01:28.934616 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8c057801-a8c5-40af-84be-e895db7583a1 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.981304 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 34740) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:28.995067 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-62148b95-3eb6-4cbc-bb8c-1bd1cea56b18 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:28.999208 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8c057801-a8c5-40af-84be-e895db7583a1 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:29.054684 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8c057801-a8c5-40af-84be-e895db7583a1 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:29.060693 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d033b1c0-68c7-4d9d-9316-e130772da434 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:29.074395 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c057801-a8c5-40af-84be-e895db7583a1 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2b952fb6-2cf1-446b-9716-fadcd5348adb,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:29.077236 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8c057801-a8c5-40af-84be-e895db7583a1 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:29.082962 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-62148b95-3eb6-4cbc-bb8c-1bd1cea56b18 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:29.163507 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-62148b95-3eb6-4cbc-bb8c-1bd1cea56b18 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:29.166033 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fd89288c-6377-41af-9b83-0bcb85b6c4c7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:29.201534 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-62148b95-3eb6-4cbc-bb8c-1bd1cea56b18 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=dcf9eb615fd7464ba99fa84690e3ce2e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2191682 Jun 17 11:01:29.202477 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62148b95-3eb6-4cbc-bb8c-1bd1cea56b18 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb3e09d4-0d0c-476f-b4d5-8f3669c81db8,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:29.204378 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 34742) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:29.205515 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-62148b95-3eb6-4cbc-bb8c-1bd1cea56b18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:29.244418 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8c057801-a8c5-40af-84be-e895db7583a1 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:29.245664 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-8c057801-a8c5-40af-84be-e895db7583a1 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3970745 Jun 17 11:01:29.257006 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c030e30b-c300-485e-beb6-b3ff220f526e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:29.279086 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c030e30b-c300-485e-beb6-b3ff220f526e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:29.392650 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c030e30b-c300-485e-beb6-b3ff220f526e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:29.395351 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c030e30b-c300-485e-beb6-b3ff220f526e admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:29.399143 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-c030e30b-c300-485e-beb6-b3ff220f526e admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/bb3e09d4-0d0c-476f-b4d5-8f3669c81db8 HTTP/1.1" status: 204 len: 168 time: 0.1912482 Jun 17 11:01:29.399143 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-877aba6e-94dd-4cd9-8c63-f5001e00a08a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:29.405556 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c030e30b-c300-485e-beb6-b3ff220f526e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb3e09d4-0d0c-476f-b4d5-8f3669c81db8,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:29.409014 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c030e30b-c300-485e-beb6-b3ff220f526e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:29.911019 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07492d76-ffec-4dea-849b-0f041ea31c2a req-14e590c6-85ed-4d2a-afe4-90834e3e26da tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:29.912737 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-07492d76-ffec-4dea-849b-0f041ea31c2a req-14e590c6-85ed-4d2a-afe4-90834e3e26da tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0742955 Jun 17 11:01:29.970806 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-07492d76-ffec-4dea-849b-0f041ea31c2a req-850da0e5-59ff-4ad5-8f3b-b1bb06e9b985 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514863 Jun 17 11:01:30.000039 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-57e19177-663e-4668-9886-fcaf8b85a157 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:30.001535 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-57e19177-663e-4668-9886-fcaf8b85a157 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=ab7c7a9f-b422-4b40-b94a-6939be91bbb8 HTTP/1.1" status: 200 len: 859 time: 0.0771585 Jun 17 11:01:30.009421 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device b77decc0-7ba4-46df-b003-b330aa03743f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:30.050865 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-b1cb3ced-9eb1-490b-84b3-b782baea9b74 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0fe823e2-06dd-4212-84a6-8e0beda57580&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0356596 Jun 17 11:01:30.066741 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f064ec15-8e47-4420-95c5-0594f77b4757 req-7af0c572-ee48-4277-abec-93c885c795aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:30.068498 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f064ec15-8e47-4420-95c5-0594f77b4757 req-7af0c572-ee48-4277-abec-93c885c795aa service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 1096 time: 0.0703285 Jun 17 11:01:30.077198 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port b77decc0-7ba4-46df-b003-b330aa03743f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:30.078331 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:30.197492 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-7d42b622-8f1b-4192-9b0e-29579254e673 service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1342616 Jun 17 11:01:30.289507 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f064ec15-8e47-4420-95c5-0594f77b4757 req-493ca9d4-5bc3-449d-9d6b-7752811da750 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:30.290997 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f064ec15-8e47-4420-95c5-0594f77b4757 req-493ca9d4-5bc3-449d-9d6b-7752811da750 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&shared=False HTTP/1.1" status: 200 len: 920 time: 0.2118299 Jun 17 11:01:30.311731 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-7e8f7918-e6c6-4fdf-b46b-1d71ddd99e12 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1228080 Jun 17 11:01:30.334420 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5f11a413-bf42-4920-9c6f-2e64a5ef0874 req-fc9b2e83-2b6f-4c70-899b-e0a37c2e6227 service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1111307 Jun 17 11:01:30.443883 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-64c4ed41-a25d-4477-a3d5-a7f4d193196e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:30.445649 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-64c4ed41-a25d-4477-a3d5-a7f4d193196e service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 1098 time: 0.0772471 Jun 17 11:01:30.485351 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f064ec15-8e47-4420-95c5-0594f77b4757 req-db2f5acf-bb44-4c5a-87b3-c6779e7ef791 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:30.486910 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f064ec15-8e47-4420-95c5-0594f77b4757 req-db2f5acf-bb44-4c5a-87b3-c6779e7ef791 service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1891894 Jun 17 11:01:30.552958 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-3edb0368-925f-4db9-813b-36f678ef0fd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:30.554474 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-3edb0368-925f-4db9-813b-36f678ef0fd7 service neutron] 10.222.0.25 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 911 time: 0.0876386 Jun 17 11:01:30.587507 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0f60f1f1-d45a-49de-a923-6a9f06e3609c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:30.589399 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0f60f1f1-d45a-49de-a923-6a9f06e3609c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 1096 time: 0.0598788 Jun 17 11:01:30.658140 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-c5e08c6d-e7ed-4642-a539-0fe50fbfb06a service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 HTTP/1.1" status: 200 len: 217 time: 0.0495582 Jun 17 11:01:30.786661 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-57f41f34-afab-43bb-ace8-086da6fb631a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:30.790421 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-57f41f34-afab-43bb-ace8-086da6fb631a service neutron] 10.222.0.25 "GET /v2.0/subnets?id=ab7c7a9f-b422-4b40-b94a-6939be91bbb8 HTTP/1.1" status: 200 len: 859 time: 0.1033697 Jun 17 11:01:30.856901 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0cd9357f-9afc-4a14-b1ed-2f446398bd1f service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0fe823e2-06dd-4212-84a6-8e0beda57580&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0500290 Jun 17 11:01:30.928177 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-e2b8eb90-3ef1-4fde-a46e-761a97ec3417 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=584d5dfc-3f46-4820-80b2-e729ce075654 HTTP/1.1" status: 200 len: 1000 time: 0.3617051 Jun 17 11:01:30.978084 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-a8802d0f-0825-4f47-bf1a-fd1822effdfe service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1055982 Jun 17 11:01:30.996032 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-30cc4189-3b52-48e8-bf20-511b1f30520e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:30.998332 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-30cc4189-3b52-48e8-bf20-511b1f30520e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 200 len: 849 time: 0.0664511 Jun 17 11:01:31.087998 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-af300c63-b658-472b-87fe-15e922bdc5e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:31.087998 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-af300c63-b658-472b-87fe-15e922bdc5e0 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=54973ccd-0b2b-4517-ad28-76a3128a2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0809047 Jun 17 11:01:31.101511 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18a039a4-1fdc-4ee4-8477-ff2659433d1e req-0db4123a-3673-40b4-b242-b6c6df95cdc2 service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1157699 Jun 17 11:01:31.194350 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-6d912a01-1838-4c3b-bd69-e436a3729b15 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0996873 Jun 17 11:01:31.206879 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a9c2c74-0307-41d4-a0e9-0565c013b43a req-1a8a342e-1766-4d25-8119-d118d7ff8e6e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:31.208794 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8a9c2c74-0307-41d4-a0e9-0565c013b43a req-1a8a342e-1766-4d25-8119-d118d7ff8e6e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0735059 Jun 17 11:01:31.253849 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8a9c2c74-0307-41d4-a0e9-0565c013b43a req-79e3cd8e-de5a-462c-89db-060df956eb66 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355418 Jun 17 11:01:31.288661 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0773b1fd-cea0-4895-92fd-1feeef6764cc req-6c93252d-0c9a-40fc-9cb2-884db2c39fef service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868418 Jun 17 11:01:32.442308 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92aafd56-9f7a-446b-a5c4-2fe62f0dea2a req-f1c5954d-3b7f-463d-8a79-c2aa2b2a7d2a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:32.444123 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-92aafd56-9f7a-446b-a5c4-2fe62f0dea2a req-f1c5954d-3b7f-463d-8a79-c2aa2b2a7d2a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0801570 Jun 17 11:01:32.493023 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-92aafd56-9f7a-446b-a5c4-2fe62f0dea2a req-2b81eb2c-5ee1-498d-9ab7-2d5e49abe68e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432675 Jun 17 11:01:33.676384 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2b6ca09-fad0-4795-834a-75e6112c5fbc req-d0641016-5c0c-4fb8-aec0-4c42480b6187 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:33.678153 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c2b6ca09-fad0-4795-834a-75e6112c5fbc req-d0641016-5c0c-4fb8-aec0-4c42480b6187 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0657532 Jun 17 11:01:33.716875 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c2b6ca09-fad0-4795-834a-75e6112c5fbc req-a00a249c-76e4-4e2a-9dd9-ad7fcbccab9f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317862 Jun 17 11:01:34.889796 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad1c32ff-e8db-427e-9316-c45d6aeef88f req-29c30d46-b278-47ad-b5d8-102f486ed956 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:34.891305 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ad1c32ff-e8db-427e-9316-c45d6aeef88f req-29c30d46-b278-47ad-b5d8-102f486ed956 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0655491 Jun 17 11:01:34.929057 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ad1c32ff-e8db-427e-9316-c45d6aeef88f req-936d2555-740e-43be-a436-f3ca6a7e505a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315425 Jun 17 11:01:36.098176 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396a5994-c3a1-4cff-8880-e9af33f927fd req-64066fea-41a8-42a8-9c98-ebc2321d67a8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:36.099635 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-396a5994-c3a1-4cff-8880-e9af33f927fd req-64066fea-41a8-42a8-9c98-ebc2321d67a8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0606229 Jun 17 11:01:36.138248 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-396a5994-c3a1-4cff-8880-e9af33f927fd req-be9acf92-9d9d-480c-9ed4-046caa655745 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330596 Jun 17 11:01:36.702103 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 2ec3e896-70d1-4c47-933b-7234e4f744ed details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:01:36.776272 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:36.805102 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 2ec3e896-70d1-4c47-933b-7234e4f744ed, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=2ec3e896-70d1-4c47-933b-7234e4f744ed,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:36.815355 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '2ec3e896-70d1-4c47-933b-7234e4f744ed', 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580', 'port_id': '2ec3e896-70d1-4c47-933b-7234e4f744ed', 'mac_address': 'fa:16:3e:15:8d:8b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ab7c7a9f-b422-4b40-b94a-6939be91bbb8', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:01:36.852795 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:36.872523 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2ec3e896-70d1-4c47-933b-7234e4f744ed {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:01:36.893565 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 2ec3e896-70d1-4c47-933b-7234e4f744ed, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=2ec3e896-70d1-4c47-933b-7234e4f744ed,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:36.963172 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:36.965930 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6d64879c-1103-4910-a230-1ee887b6c63d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:37.013506 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=2ec3e896-70d1-4c47-933b-7234e4f744ed,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:37.017212 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:37.317006 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3257f74-fcc8-4dfe-87dd-37e99d63aed2 req-41b7d099-81b6-4bf7-9b7a-f5844b151f42 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:37.317586 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b3257f74-fcc8-4dfe-87dd-37e99d63aed2 req-41b7d099-81b6-4bf7-9b7a-f5844b151f42 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0670280 Jun 17 11:01:37.357516 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b3257f74-fcc8-4dfe-87dd-37e99d63aed2 req-1f2b472b-c185-4648-b898-6afb53fe8195 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327654 Jun 17 11:01:38.053257 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:01:38.537584 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78977221-5b69-44b3-89ef-800d1093e570 req-dae15237-e0fe-4bb2-b560-991bbcdb2d91 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:38.539110 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-78977221-5b69-44b3-89ef-800d1093e570 req-dae15237-e0fe-4bb2-b560-991bbcdb2d91 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0663631 Jun 17 11:01:38.578349 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-78977221-5b69-44b3-89ef-800d1093e570 req-21522e22-ce2d-4940-aa3f-b6c721860ae0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329492 Jun 17 11:01:39.752858 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c852788a-7e58-49e1-9354-0f106e350640 req-1d08f395-6b29-4d14-800e-57b3869cad91 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:39.754298 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c852788a-7e58-49e1-9354-0f106e350640 req-1d08f395-6b29-4d14-800e-57b3869cad91 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0650783 Jun 17 11:01:39.790604 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c852788a-7e58-49e1-9354-0f106e350640 req-e8c4fc3c-f4cc-4ce1-821d-f5323c588b3f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0307653 Jun 17 11:01:40.965831 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ea8ec0-bff8-4561-9ef9-ed909abae7af req-44b31cf8-081a-4183-8c3e-8297623021cc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:40.967304 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-61ea8ec0-bff8-4561-9ef9-ed909abae7af req-44b31cf8-081a-4183-8c3e-8297623021cc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0664222 Jun 17 11:01:41.007073 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-61ea8ec0-bff8-4561-9ef9-ed909abae7af req-a20bd142-84e5-4655-b259-ed65a8d94f06 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340669 Jun 17 11:01:41.579435 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['2ec3e896-70d1-4c47-933b-7234e4f744ed'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:01:42.189821 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814738d8-2dbc-478d-9970-7213e2c54274 req-0bef10ac-de0d-4519-b755-f63b801fbb5f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:42.189821 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-814738d8-2dbc-478d-9970-7213e2c54274 req-0bef10ac-de0d-4519-b755-f63b801fbb5f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0668459 Jun 17 11:01:42.233692 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-814738d8-2dbc-478d-9970-7213e2c54274 req-870467d4-546c-412c-80a6-fe3a78619411 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362270 Jun 17 11:01:43.423511 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767e7a71-84af-4ebb-83b7-fb4db49df192 req-be323ad0-7318-4c53-a906-d3ac1b6acc4e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:43.425662 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-767e7a71-84af-4ebb-83b7-fb4db49df192 req-be323ad0-7318-4c53-a906-d3ac1b6acc4e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0754712 Jun 17 11:01:43.462594 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-767e7a71-84af-4ebb-83b7-fb4db49df192 req-c4dba3c0-d9ed-4a22-90f6-36999fc3a31f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313680 Jun 17 11:01:44.634717 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d3462c-7429-479b-bf56-cdd888e44f6a req-665b3a14-d6d1-4894-a931-14b92cfcc1ac tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:44.636286 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-25d3462c-7429-479b-bf56-cdd888e44f6a req-665b3a14-d6d1-4894-a931-14b92cfcc1ac tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 943 time: 0.0662715 Jun 17 11:01:44.642179 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:01:44.681992 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-25d3462c-7429-479b-bf56-cdd888e44f6a req-d22cbd34-b58f-4f17-8377-9971557dfc6f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393293 Jun 17 11:01:44.741725 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:44.756267 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': 'f47e3e1a-e4f2-4b14-b64a-a67d84ad7677', 'network_id': '0fe823e2-06dd-4212-84a6-8e0beda57580', 'port_id': 'f47e3e1a-e4f2-4b14-b64a-a67d84ad7677', 'mac_address': 'fa:16:3e:e5:aa:19', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ab7c7a9f-b422-4b40-b94a-6939be91bbb8', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:01:44.806331 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:44.820007 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:01:44.839200 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:44.952763 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:44.954808 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:45.041781 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:45.046681 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:45.855924 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9336080-1acd-486a-96d2-436006e53c74 req-825a7baf-c1c5-4632-bf98-43fda6e97049 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:45.857379 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d9336080-1acd-486a-96d2-436006e53c74 req-825a7baf-c1c5-4632-bf98-43fda6e97049 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 944 time: 0.0650394 Jun 17 11:01:45.894283 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d9336080-1acd-486a-96d2-436006e53c74 req-3abb585d-2d0f-4fcf-8403-8f6681ce4a23 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311363 Jun 17 11:01:47.080721 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-336dbc94-bc1f-4931-a797-3e611a1e4eb6 req-a183d09b-9eb4-4e28-b061-654638aae560 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:47.082229 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-336dbc94-bc1f-4931-a797-3e611a1e4eb6 req-a183d09b-9eb4-4e28-b061-654638aae560 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 944 time: 0.0726385 Jun 17 11:01:47.126621 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-336dbc94-bc1f-4931-a797-3e611a1e4eb6 req-fbcdee3c-8481-4519-a922-ca42ebe4669a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387521 Jun 17 11:01:48.318776 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0612f120-a564-4100-8d60-49581c8532ab req-609a7f10-bbf0-4511-bee5-8ca15fe9ff34 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:48.320261 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0612f120-a564-4100-8d60-49581c8532ab req-609a7f10-bbf0-4511-bee5-8ca15fe9ff34 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 944 time: 0.0634029 Jun 17 11:01:48.360860 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0612f120-a564-4100-8d60-49581c8532ab req-51d8866d-ef8e-49af-81c3-3c5693dd84a9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347919 Jun 17 11:01:49.531215 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf495c4-578a-4877-958f-45ad65036c92 req-21865c6f-f0f6-4ae5-ad0a-7c2c39ad4956 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:49.532531 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-faf495c4-578a-4877-958f-45ad65036c92 req-21865c6f-f0f6-4ae5-ad0a-7c2c39ad4956 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 944 time: 0.0620325 Jun 17 11:01:49.571117 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-faf495c4-578a-4877-958f-45ad65036c92 req-56ea052b-e690-47b8-a387-641b77026dde tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325778 Jun 17 11:01:50.400714 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['f47e3e1a-e4f2-4b14-b64a-a67d84ad7677'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:01:50.626810 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-0e2b5790-530b-4bca-b29a-37af3e7bd7a4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:50.758008 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08163218-6eb1-423f-8c57-4398b5ff918a req-5426f523-d393-4a2d-b27a-de96f85815ce tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:50.759584 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-08163218-6eb1-423f-8c57-4398b5ff918a req-5426f523-d393-4a2d-b27a-de96f85815ce tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 944 time: 0.0685370 Jun 17 11:01:50.801077 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-08163218-6eb1-423f-8c57-4398b5ff918a req-9bfe49db-a06d-4281-b95d-0192decb10e6 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0346553 Jun 17 11:01:50.814104 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 2ec3e896-70d1-4c47-933b-7234e4f744ed up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:50.959776 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 2ec3e896-70d1-4c47-933b-7234e4f744ed completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:50.966062 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 2ec3e896-70d1-4c47-933b-7234e4f744ed triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:50.966062 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:51.044770 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:51.075706 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a1113dd8-dbb2-4892-8625-6d6a3fdd1289', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ec3e896-70d1-4c47-933b-7234e4f744ed'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:01:51.078571 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd4dd98c-891f-4f2b-9221-6f9af652ddb0" -d '{"events": [{"server_uuid": "a1113dd8-dbb2-4892-8625-6d6a3fdd1289", "name": "network-vif-plugged", "status": "completed", "tag": "2ec3e896-70d1-4c47-933b-7234e4f744ed"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:01:51.090755 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 2ec3e896-70d1-4c47-933b-7234e4f744ed, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=2ec3e896-70d1-4c47-933b-7234e4f744ed,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:51.119018 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:01:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-136f13b5-8ae2-464b-bf71-fa6b523a215c x-openstack-request-id: req-136f13b5-8ae2-464b-bf71-fa6b523a215c {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:01:51.119018 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a1113dd8-dbb2-4892-8625-6d6a3fdd1289", "name": "network-vif-plugged", "status": "completed", "tag": "2ec3e896-70d1-4c47-933b-7234e4f744ed", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:01:51.119018 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-136f13b5-8ae2-464b-bf71-fa6b523a215c {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:01:51.119527 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a1113dd8-dbb2-4892-8625-6d6a3fdd1289', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ec3e896-70d1-4c47-933b-7234e4f744ed', 'code': 200} Jun 17 11:01:51.157933 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:51.159897 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:51.209326 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=2ec3e896-70d1-4c47-933b-7234e4f744ed,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:51.212432 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:51.818028 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 35210) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:51.903795 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 35218) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:52.016451 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.031613 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a35bcfed-4b49-42dd-9b2f-3c380e778e1c req-01697832-3eb6-457f-86aa-43210f36b08b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:52.033084 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a35bcfed-4b49-42dd-9b2f-3c380e778e1c req-01697832-3eb6-457f-86aa-43210f36b08b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 944 time: 0.1030102 Jun 17 11:01:52.057403 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-09cddc86-4cde-478f-93e9-68177736be55 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.108316 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a35bcfed-4b49-42dd-9b2f-3c380e778e1c req-5dd1f00f-c4c3-47e4-ac62-476251d8c7c0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655153 Jun 17 11:01:52.164327 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.239859 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.244822 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:52.287144 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=2e4270db05aa4c0d8c2bb51ffab5f2b8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4679668 Jun 17 11:01:52.290384 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 35230) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:52.305773 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=711fcc7a-a810-4024-8627-b639c4b85c24,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:52.317070 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.317438 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.318007 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.318376 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.318735 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.319118 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.319476 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.319826 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.320179 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.320530 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.320871 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.321213 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.325758 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:52.376439 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.413662 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.485226 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-09cddc86-4cde-478f-93e9-68177736be55 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.487476 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c20cb6-d300-4d50-8da7-0877fbd752d8 req-fa8dcd80-3318-482a-9c86-24fbac709fa7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:52.490002 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c7c20cb6-d300-4d50-8da7-0877fbd752d8 req-fa8dcd80-3318-482a-9c86-24fbac709fa7 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 1098 time: 0.1569664 Jun 17 11:01:52.569307 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-09cddc86-4cde-478f-93e9-68177736be55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.569624 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.572617 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.578546 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4c4cebc8-44ed-44cc-8150-3cd0e215a1cd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:52.578920 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/711fcc7a-a810-4024-8627-b639c4b85c24 HTTP/1.1" status: 204 len: 168 time: 0.2823138 Jun 17 11:01:52.578920 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-df7600c1-cd54-410a-9a28-61a762b590df admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:52.584107 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=711fcc7a-a810-4024-8627-b639c4b85c24,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:52.594541 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.595076 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.595527 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.596106 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.596745 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.597657 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.598122 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.598724 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.599305 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.600354 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.600922 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.601476 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:52.612869 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:52.626146 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-09cddc86-4cde-478f-93e9-68177736be55 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=6beac1eb56084c4fb2f7e9047c8e030f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7210529 Jun 17 11:01:52.627115 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09cddc86-4cde-478f-93e9-68177736be55 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f23fceed-0080-423b-b9eb-9aa67496803d,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:52.629282 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 35238) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:52.630385 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-09cddc86-4cde-478f-93e9-68177736be55 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:52.681811 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e76b389c-6a37-41ac-91e1-b2ea70e1abd3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.704109 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e76b389c-6a37-41ac-91e1-b2ea70e1abd3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.826615 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e76b389c-6a37-41ac-91e1-b2ea70e1abd3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.829819 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e76b389c-6a37-41ac-91e1-b2ea70e1abd3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:52.834978 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-e76b389c-6a37-41ac-91e1-b2ea70e1abd3 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/f23fceed-0080-423b-b9eb-9aa67496803d HTTP/1.1" status: 204 len: 168 time: 0.2004552 Jun 17 11:01:52.834978 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-de1bc256-cac8-4663-b089-17f0a8426f24 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:52.840256 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e76b389c-6a37-41ac-91e1-b2ea70e1abd3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f23fceed-0080-423b-b9eb-9aa67496803d,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:52.842749 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e76b389c-6a37-41ac-91e1-b2ea70e1abd3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:52.982093 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 35246) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:53.133996 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bf4c3dab-0021-4795-b10c-df4e3981f31a admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.251644 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bf4c3dab-0021-4795-b10c-df4e3981f31a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.303555 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b781caed-bd21-42e4-99b5-2a7b194c548b req-ef67f62b-617a-43cc-bd1d-07c278bc9280 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:53.305260 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b781caed-bd21-42e4-99b5-2a7b194c548b req-ef67f62b-617a-43cc-bd1d-07c278bc9280 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 944 time: 0.0718255 Jun 17 11:01:53.311995 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bf4c3dab-0021-4795-b10c-df4e3981f31a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.321448 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e4a435d0-df70-4b0e-88e7-50b90b9dc089 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:53.323629 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-33d83f31-22ca-46f9-8ed4-55481bfb2a64 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.352416 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf4c3dab-0021-4795-b10c-df4e3981f31a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72596418-96f8-497d-b40f-5ca6e7524a69,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:53.353669 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b781caed-bd21-42e4-99b5-2a7b194c548b req-2893139d-b179-4958-a4f6-08e772905b90 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375845 Jun 17 11:01:53.356727 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-bf4c3dab-0021-4795-b10c-df4e3981f31a admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=d1f13908bafe4b89b7512cea346bd444&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3736193 Jun 17 11:01:53.357722 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-bf4c3dab-0021-4795-b10c-df4e3981f31a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:53.359898 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 35264) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:53.410647 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ac7e2bec-8263-40ea-b41c-17115f6c116f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.431555 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ac7e2bec-8263-40ea-b41c-17115f6c116f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.529301 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ac7e2bec-8263-40ea-b41c-17115f6c116f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.532545 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ac7e2bec-8263-40ea-b41c-17115f6c116f admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.536175 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-ac7e2bec-8263-40ea-b41c-17115f6c116f admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/72596418-96f8-497d-b40f-5ca6e7524a69 HTTP/1.1" status: 204 len: 168 time: 0.1739354 Jun 17 11:01:53.536175 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f940d3b8-6f53-4cd9-9e20-a683de41ffa6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:53.545157 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7e2bec-8263-40ea-b41c-17115f6c116f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72596418-96f8-497d-b40f-5ca6e7524a69,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:53.547604 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-ac7e2bec-8263-40ea-b41c-17115f6c116f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:53.564307 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 35276) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:53.564892 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.583378 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b172f274-5bcc-48f6-83b7-030346b92054 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.679572 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b172f274-5bcc-48f6-83b7-030346b92054 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.723878 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b172f274-5bcc-48f6-83b7-030346b92054 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.727251 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-36057507-3294-4c2d-8e77-a4e034d398f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:53.763154 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-b172f274-5bcc-48f6-83b7-030346b92054 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=e018c9cc2f8c4b99a1590a55b5be6735&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1977158 Jun 17 11:01:53.765674 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b172f274-5bcc-48f6-83b7-030346b92054 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f10ab2a5-4dd3-4370-9da7-dbc8bb5f030b,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:53.766323 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 35280) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:53.771767 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b172f274-5bcc-48f6-83b7-030346b92054 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:53.848647 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c7c20cb6-d300-4d50-8da7-0877fbd752d8 req-e47f3e97-999b-4fdb-8418-147308fc7f8f service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520079 Jun 17 11:01:53.849463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-554b2939-9860-43ed-ae11-122fc131b3c6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:53.878580 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-554b2939-9860-43ed-ae11-122fc131b3c6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:54.004412 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-554b2939-9860-43ed-ae11-122fc131b3c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:54.009695 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-554b2939-9860-43ed-ae11-122fc131b3c6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:54.012100 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-554b2939-9860-43ed-ae11-122fc131b3c6 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/f10ab2a5-4dd3-4370-9da7-dbc8bb5f030b HTTP/1.1" status: 204 len: 168 time: 0.2444866 Jun 17 11:01:54.013658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-09cddc86-4cde-478f-93e9-68177736be55 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:54.034082 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-554b2939-9860-43ed-ae11-122fc131b3c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f10ab2a5-4dd3-4370-9da7-dbc8bb5f030b,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:54.039558 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-554b2939-9860-43ed-ae11-122fc131b3c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:54.353147 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 35296) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:54.367104 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-36393ddd-8ba0-4e7c-9924-7b890298a008 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:54.466537 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:54.470352 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-36393ddd-8ba0-4e7c-9924-7b890298a008 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:54.553226 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-36393ddd-8ba0-4e7c-9924-7b890298a008 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:54.557189 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-04b936e2-9fbe-452a-83e1-51bb4d6aa62a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:54.583966 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2659ab7-177f-4cba-8b3c-9dbc94f50394 req-52537cad-65b5-49e3-afda-acea0c8f0a7b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:54.584971 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d2659ab7-177f-4cba-8b3c-9dbc94f50394 req-52537cad-65b5-49e3-afda-acea0c8f0a7b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 944 time: 0.1039400 Jun 17 11:01:54.620277 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36393ddd-8ba0-4e7c-9924-7b890298a008 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdf4a0db-906b-4656-890f-bac98ac43a9d,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:54.627797 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-36393ddd-8ba0-4e7c-9924-7b890298a008 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=efa3a5a298c54bbf96aacc50cc39668c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2702992 Jun 17 11:01:54.627797 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-36393ddd-8ba0-4e7c-9924-7b890298a008 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:54.628138 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 35310) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:01:54.645920 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d2659ab7-177f-4cba-8b3c-9dbc94f50394 req-41f94dc0-2411-49d6-8034-47f5a8c1606a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496638 Jun 17 11:01:54.699720 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7d5fb13e-6723-49fa-85d8-2dbfbfa05e7d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:54.719182 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7d5fb13e-6723-49fa-85d8-2dbfbfa05e7d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:54.826240 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7d5fb13e-6723-49fa-85d8-2dbfbfa05e7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:54.828846 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7d5fb13e-6723-49fa-85d8-2dbfbfa05e7d admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:54.829982 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-7d5fb13e-6723-49fa-85d8-2dbfbfa05e7d admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/fdf4a0db-906b-4656-890f-bac98ac43a9d HTTP/1.1" status: 204 len: 168 time: 0.2000465 Jun 17 11:01:54.830826 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-ce30280b-6256-4b48-a302-9beeb8a777a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:54.838970 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d5fb13e-6723-49fa-85d8-2dbfbfa05e7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdf4a0db-906b-4656-890f-bac98ac43a9d,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:54.841542 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-7d5fb13e-6723-49fa-85d8-2dbfbfa05e7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:55.861094 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7378b028-168d-4dc4-a265-805beec9c84b req-7e06190f-8a12-4acf-a64b-a505daef7d20 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:55.866256 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7378b028-168d-4dc4-a265-805beec9c84b req-7e06190f-8a12-4acf-a64b-a505daef7d20 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 944 time: 0.1008260 Jun 17 11:01:55.904596 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7378b028-168d-4dc4-a265-805beec9c84b req-310d163b-8c30-440b-aa3f-a0e75ffef16c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331082 Jun 17 11:01:56.816415 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:57.081163 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:01:57.107575 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fadcd95d-b675-480c-b3a2-c6bad0a3566d req-99bf5c19-b13d-4491-9325-2239d30c7062 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:57.116485 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fadcd95d-b675-480c-b3a2-c6bad0a3566d req-99bf5c19-b13d-4491-9325-2239d30c7062 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 944 time: 0.0827909 Jun 17 11:01:57.161400 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fadcd95d-b675-480c-b3a2-c6bad0a3566d req-6b62ce46-d58f-4b2c-b86b-bb54d14bc5a0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438213 Jun 17 11:01:57.204850 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:01:57.208993 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:01:57.214223 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:57.290862 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:57.316912 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4b6a250-cbe9-4e83-88f3-7dfe006deb6b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f47e3e1a-e4f2-4b14-b64a-a67d84ad7677'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:01:57.319242 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-018d3d1c-003b-440f-aa71-e37ac63cd5e2" -d '{"events": [{"server_uuid": "a4b6a250-cbe9-4e83-88f3-7dfe006deb6b", "name": "network-vif-plugged", "status": "completed", "tag": "f47e3e1a-e4f2-4b14-b64a-a67d84ad7677"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:01:57.333216 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:01:57.359823 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:01:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-38dc5937-29fb-4a40-bba2-6c3846daad7f x-openstack-request-id: req-38dc5937-29fb-4a40-bba2-6c3846daad7f {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:01:57.360122 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a4b6a250-cbe9-4e83-88f3-7dfe006deb6b", "name": "network-vif-plugged", "status": "completed", "tag": "f47e3e1a-e4f2-4b14-b64a-a67d84ad7677", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:01:57.360380 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-38dc5937-29fb-4a40-bba2-6c3846daad7f {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:01:57.360779 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4b6a250-cbe9-4e83-88f3-7dfe006deb6b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f47e3e1a-e4f2-4b14-b64a-a67d84ad7677', 'code': 200} Jun 17 11:01:57.404026 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:01:57.407423 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:01:57.454589 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:01:57.462207 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.462566 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.462934 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.463278 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.463617 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.463948 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.464280 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.464609 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.464938 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.465282 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.465595 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.465918 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:01:57.470389 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:01:57.831913 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4aac54e-1bc1-4065-8e3a-7302143bf291 req-3709b3c8-4927-45cc-846f-f0cab8a3234c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:57.833429 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d4aac54e-1bc1-4065-8e3a-7302143bf291 req-3709b3c8-4927-45cc-846f-f0cab8a3234c service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 1098 time: 0.0630198 Jun 17 11:01:57.881501 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d4aac54e-1bc1-4065-8e3a-7302143bf291 req-0e0dec1e-7da2-4502-a9d9-a4f21f08242e service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408831 Jun 17 11:01:58.380447 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-720b8c16-7e19-425b-a77a-ae5cdb73931f req-81ecb8f3-2a48-4dfe-a3c8-cb1a17cf6189 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:58.381897 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-720b8c16-7e19-425b-a77a-ae5cdb73931f req-81ecb8f3-2a48-4dfe-a3c8-cb1a17cf6189 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0784733 Jun 17 11:01:58.428890 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-720b8c16-7e19-425b-a77a-ae5cdb73931f req-1e7b5c4e-8ac4-46c7-8a5a-f7d43fcb9160 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403669 Jun 17 11:01:59.608835 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90115801-1ef1-4d70-8ea1-c5657ce142ab req-c4a6756f-293b-4682-808c-c7904b7f5cf0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:01:59.610325 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-90115801-1ef1-4d70-8ea1-c5657ce142ab req-c4a6756f-293b-4682-808c-c7904b7f5cf0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0661528 Jun 17 11:01:59.652129 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-90115801-1ef1-4d70-8ea1-c5657ce142ab req-784379a7-5e65-4f2f-a955-4ec02c2c8290 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357544 Jun 17 11:02:01.109686 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4484017a-e073-402e-8eaa-011a4aacba96 req-3366c1b9-7fc3-4704-aa73-c9e0c7c4055f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:01.111489 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4484017a-e073-402e-8eaa-011a4aacba96 req-3366c1b9-7fc3-4704-aa73-c9e0c7c4055f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0699489 Jun 17 11:02:01.160607 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4484017a-e073-402e-8eaa-011a4aacba96 req-1ec511bc-2e04-4ddb-b7f2-d00e360b3d99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430748 Jun 17 11:02:01.370189 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 35528) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:01.507616 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a482f60c-f6c0-4688-887d-dfae1327c80d admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:01.618486 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a482f60c-f6c0-4688-887d-dfae1327c80d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:01.695142 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a482f60c-f6c0-4688-887d-dfae1327c80d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:01.698865 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:01.737350 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-a482f60c-f6c0-4688-887d-dfae1327c80d admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=3059bbd6a31d4379a35ac4505c19d1ce&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3623936 Jun 17 11:02:01.737350 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a482f60c-f6c0-4688-887d-dfae1327c80d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a190d9c6-2bc0-44ae-9d08-5fb3cad4292e,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:01.740272 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a482f60c-f6c0-4688-887d-dfae1327c80d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:01.741136 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 35534) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:01.786438 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b418d7-2154-4650-8038-b519eb50db5a req-12cb8254-2615-4774-a1af-d208eb61c605 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:01.787944 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d0b418d7-2154-4650-8038-b519eb50db5a req-12cb8254-2615-4774-a1af-d208eb61c605 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 1098 time: 0.0964913 Jun 17 11:02:01.795150 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-027376a2-99f8-49ef-87eb-ac0696b57d91 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:01.802517 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ef2e492-ed54-43da-b8fe-70c30eb64e20 req-33217d58-b02a-4fc0-9799-80217558825e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:01.805077 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ef2e492-ed54-43da-b8fe-70c30eb64e20 req-33217d58-b02a-4fc0-9799-80217558825e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.1038640 Jun 17 11:02:01.827074 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-027376a2-99f8-49ef-87eb-ac0696b57d91 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:01.897223 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ef2e492-ed54-43da-b8fe-70c30eb64e20 req-a69037be-558b-4669-8ef2-e163e6337a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0831432 Jun 17 11:02:01.938011 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b418d7-2154-4650-8038-b519eb50db5a req-e0d1ca71-7db7-47c4-9f96-ba66c7ee6be1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:01.939878 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d0b418d7-2154-4650-8038-b519eb50db5a req-e0d1ca71-7db7-47c4-9f96-ba66c7ee6be1 service neutron] 10.222.0.25 "GET /v2.0/networks?id=0fe823e2-06dd-4212-84a6-8e0beda57580 HTTP/1.1" status: 200 len: 920 time: 0.1345909 Jun 17 11:02:01.958428 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-027376a2-99f8-49ef-87eb-ac0696b57d91 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:01.961275 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-027376a2-99f8-49ef-87eb-ac0696b57d91 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:01.962986 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-027376a2-99f8-49ef-87eb-ac0696b57d91 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/a190d9c6-2bc0-44ae-9d08-5fb3cad4292e HTTP/1.1" status: 204 len: 168 time: 0.2207670 Jun 17 11:02:01.965547 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-bf4c3dab-0021-4795-b10c-df4e3981f31a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:01.978744 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-027376a2-99f8-49ef-87eb-ac0696b57d91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a190d9c6-2bc0-44ae-9d08-5fb3cad4292e,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:01.985972 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-027376a2-99f8-49ef-87eb-ac0696b57d91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:02.029122 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d0b418d7-2154-4650-8038-b519eb50db5a req-529873bf-e06d-4da9-bc7c-12a7500d9b5f service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 HTTP/1.1" status: 200 len: 217 time: 0.0784559 Jun 17 11:02:02.111922 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b418d7-2154-4650-8038-b519eb50db5a req-e88ccc1f-c4e5-4c88-9cf7-eefe034f4096 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:02.111922 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d0b418d7-2154-4650-8038-b519eb50db5a req-e88ccc1f-c4e5-4c88-9cf7-eefe034f4096 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=ab7c7a9f-b422-4b40-b94a-6939be91bbb8 HTTP/1.1" status: 200 len: 859 time: 0.0677009 Jun 17 11:02:02.148109 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d0b418d7-2154-4650-8038-b519eb50db5a req-6679f5b0-f105-4eed-b3bb-926d67f2464d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0fe823e2-06dd-4212-84a6-8e0beda57580&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0366364 Jun 17 11:02:02.256349 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d0b418d7-2154-4650-8038-b519eb50db5a req-9cb3b20c-32a1-42d6-a516-73f05013ef86 service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0992138 Jun 17 11:02:02.359827 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d0b418d7-2154-4650-8038-b519eb50db5a req-15c25a39-2d35-400f-b96f-912444631dda service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0962584 Jun 17 11:02:02.843387 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-34e06cf6-333f-4057-90db-330ceef9c99e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:02.844957 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-34e06cf6-333f-4057-90db-330ceef9c99e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 814 time: 0.1083152 Jun 17 11:02:02.861577 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-93e0a1f9-a867-45ee-ac4c-6cbcf1701b0d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/quotas/5a3d5a50b1194ca594e398fd941cbe5f HTTP/1.1" status: 200 len: 375 time: 0.0106204 Jun 17 11:02:02.953834 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-87c217ce-7044-4815-9450-2207723f8808 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0866859 Jun 17 11:02:03.074800 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-b5568bb0-d9da-4cf5-bf19-048872cabec6 service neutron] 10.222.0.41 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1143310 Jun 17 11:02:03.122023 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aa1a35a-557c-44e4-839b-03469e9e91f7 req-7fa55799-9650-43fe-a99d-64fa974292ba tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:03.123583 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4aa1a35a-557c-44e4-839b-03469e9e91f7 req-7fa55799-9650-43fe-a99d-64fa974292ba tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0893419 Jun 17 11:02:03.215383 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4aa1a35a-557c-44e4-839b-03469e9e91f7 req-88c911d7-de18-4886-95e2-c8e70ff72780 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766535 Jun 17 11:02:03.301304 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-93a46922-593d-4180-8646-aff7df5940f2 service neutron] 10.222.0.41 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2114968 Jun 17 11:02:03.621486 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-16aadd2e-268d-456b-9008-6ddf9ac5cad2 req-82a18e28-be92-45ed-8222-676ef115e892 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 210 time: 0.0426924 Jun 17 11:02:04.419968 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aab9be9e-131a-4840-905d-a290fa0d0e6f req-cac40083-923b-4a00-a39a-84b552d21289 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:04.421577 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-aab9be9e-131a-4840-905d-a290fa0d0e6f req-cac40083-923b-4a00-a39a-84b552d21289 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0859902 Jun 17 11:02:04.463554 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-aab9be9e-131a-4840-905d-a290fa0d0e6f req-3e08522e-23dd-424d-a938-4f1e2a95c096 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0364840 Jun 17 11:02:04.767851 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83651ed3-1d81-4b34-90d4-167b3a326cc5 req-f50b8493-ee1c-4bdf-9ff6-34a942b0bc27 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 210 time: 0.0324671 Jun 17 11:02:05.580525 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-ab4082de-ecf1-4678-92f3-5a91cc1b7fb4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:05.582002 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-ab4082de-ecf1-4678-92f3-5a91cc1b7fb4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 814 time: 0.1124194 Jun 17 11:02:05.603484 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Request body: {'port': {'device_id': 'e92f4703-97e8-4a42-84dd-eaab237e23e3', 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b', 'admin_state_up': True, 'tenant_id': '5a3d5a50b1194ca594e398fd941cbe5f'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:02:05.648540 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-928db2fc-d376-4501-8e13-f32d1114e1fe req-cdbbba4c-9368-4b61-9bfb-6419fb821738 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:05.650122 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-928db2fc-d376-4501-8e13-f32d1114e1fe req-cdbbba4c-9368-4b61-9bfb-6419fb821738 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0677094 Jun 17 11:02:05.693738 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-928db2fc-d376-4501-8e13-f32d1114e1fe req-1e504c91-62d8-4ba0-be13-c12736698ae1 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366147 Jun 17 11:02:05.832524 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Made reservation on behalf of 5a3d5a50b1194ca594e398fd941cbe5f for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:02:05.836100 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:05.923680 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ff3d8736-8969-4b16-884e-8b415fcbcefd req-44f94e7d-aa8a-4d87-ba75-458e4ff023a3 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 210 time: 0.0360889 Jun 17 11:02:05.987497 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Allocated IP 172.20.0.14 (bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b/c10bc074-5591-4fbf-953f-e4097d48cc79/7f393d5b-3d64-445d-8452-77f330f822c4) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:02:06.135976 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:06.238874 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:06.242876 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:06.253971 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5df2bc70-d7c4-4355-b3d7-81d2732dfd9d', 'b9d0052c-f650-4dae-8e30-09f806a67cfb', 'ab14f0f0-986e-47dd-a78c-224cbab21a85'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:02:06.277831 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:02:06.281953 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:02:06.285829 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:02:06.326072 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Pushing event updated for resources: {'Port': ['ID=7f393d5b-3d64-445d-8452-77f330f822c4,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:06.330445 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:06.347779 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:06.348658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:06.456069 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8577099 Jun 17 11:02:06.469766 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Request body: {'port': {'device_id': 'e92f4703-97e8-4a42-84dd-eaab237e23e3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:02:06.551694 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:06.769290 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:06.878184 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7f393d5b-3d64-445d-8452-77f330f822c4 {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:02:06.888291 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:06.905147 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Transition to ACTIVE for port object 7f393d5b-3d64-445d-8452-77f330f822c4 will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:02:06.927247 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc88f77-6c5b-462b-ad24-f7d0cd9af15b req-6401efba-f1d2-4101-8fab-6434a71a775f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:06.928702 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3cc88f77-6c5b-462b-ad24-f7d0cd9af15b req-6401efba-f1d2-4101-8fab-6434a71a775f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0903945 Jun 17 11:02:06.971418 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3cc88f77-6c5b-462b-ad24-f7d0cd9af15b req-21656b2a-81d2-4d78-a5d1-574192097b49 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369239 Jun 17 11:02:06.972406 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:06.974390 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:07.053134 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Pushing event updated for resources: {'Port': ['ID=7f393d5b-3d64-445d-8452-77f330f822c4,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:07.058727 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:07.158312 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Attempting to bind port 7f393d5b-3d64-445d-8452-77f330f822c4 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:02:07.158635 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Attempting to bind port 7f393d5b-3d64-445d-8452-77f330f822c4 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:02:07.158994 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Attempting to bind port 7f393d5b-3d64-445d-8452-77f330f822c4 on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:02:07.167019 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Port 7f393d5b-3d64-445d-8452-77f330f822c4 on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:02:07.167336 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Attempting to bind port 7f393d5b-3d64-445d-8452-77f330f822c4 on network bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:02:07.177512 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 2, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:02:07.177845 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Checking segment: {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:02:07.178273 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Bound using segment: {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:02:07.178703 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Bound port: 7f393d5b-3d64-445d-8452-77f330f822c4, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f32f5ed9-539a-457e-8330-d3310fcdf7eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:02:07.179071 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:07.194943 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff59231-049b-4fe8-984f-56e48a1925a6 req-36d53c71-a254-4606-9dac-b6f92de7d6a3 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:07.196386 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ff59231-049b-4fe8-984f-56e48a1925a6 req-36d53c71-a254-4606-9dac-b6f92de7d6a3 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.1186991 Jun 17 11:02:07.274670 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7ff59231-049b-4fe8-984f-56e48a1925a6 req-ca3cc527-0d8b-405f-94ee-8718234fc1b5 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720747 Jun 17 11:02:07.276902 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] For port 7f393d5b-3d64-445d-8452-77f330f822c4, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:02:07.279959 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] For port 7f393d5b-3d64-445d-8452-77f330f822c4, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=7f393d5b-3d64-445d-8452-77f330f822c4,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:02:07.364000 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:07.366382 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:07.401489 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:07.402097 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:07.403503 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] 10.222.0.25 "PUT /v2.0/ports/7f393d5b-3d64-445d-8452-77f330f822c4 HTTP/1.1" status: 200 len: 1094 time: 0.9389315 Jun 17 11:02:07.403992 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e92f4703-97e8-4a42-84dd-eaab237e23e3', 'tag': '7f393d5b-3d64-445d-8452-77f330f822c4'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:02:07.406311 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e48fdbaf-90be-4d9c-82de-de1528b41509" -d '{"events": [{"name": "network-changed", "server_uuid": "e92f4703-97e8-4a42-84dd-eaab237e23e3", "tag": "7f393d5b-3d64-445d-8452-77f330f822c4"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:02:07.432027 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Pushing event updated for resources: {'Port': ['ID=7f393d5b-3d64-445d-8452-77f330f822c4,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:07.435132 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:07.449989 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:02:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03a8dc6c-1730-4e98-9fbc-f2df03797a62 x-openstack-request-id: req-03a8dc6c-1730-4e98-9fbc-f2df03797a62 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:02:07.450362 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e92f4703-97e8-4a42-84dd-eaab237e23e3", "tag": "7f393d5b-3d64-445d-8452-77f330f822c4", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:02:07.450649 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-03a8dc6c-1730-4e98-9fbc-f2df03797a62 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:02:07.451112 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e92f4703-97e8-4a42-84dd-eaab237e23e3', 'tag': '7f393d5b-3d64-445d-8452-77f330f822c4', 'status': 'completed', 'code': 200} Jun 17 11:02:08.141072 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7507d62c-fd16-4a0c-91b5-db5e548b787e req-0d6c7661-939e-4d5a-a8a1-9e16a1f5cb66 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:08.142656 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7507d62c-fd16-4a0c-91b5-db5e548b787e req-0d6c7661-939e-4d5a-a8a1-9e16a1f5cb66 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0632246 Jun 17 11:02:08.182011 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7507d62c-fd16-4a0c-91b5-db5e548b787e req-2f0c7833-007c-4deb-857d-d8212861ec06 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329781 Jun 17 11:02:08.302300 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-c8ba5ecb-988d-49a4-86b6-0c032bb53802 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:08.304220 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-c8ba5ecb-988d-49a4-86b6-0c032bb53802 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 1097 time: 0.0580189 Jun 17 11:02:08.349613 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-760fdafb-14fa-4f1b-a183-e8650166ce30 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7f393d5b-3d64-445d-8452-77f330f822c4 HTTP/1.1" status: 200 len: 217 time: 0.0368598 Jun 17 11:02:08.451095 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-313ad5c6-c6fe-4df3-b4f3-98ead70a4dab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:08.452444 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-313ad5c6-c6fe-4df3-b4f3-98ead70a4dab service neutron] 10.222.0.25 "GET /v2.0/subnets?id=c10bc074-5591-4fbf-953f-e4097d48cc79 HTTP/1.1" status: 200 len: 854 time: 0.0711291 Jun 17 11:02:08.484440 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d0797a-8c68-4ca8-909f-f466a2a1ad32 req-b6d0a8f4-85bc-4c57-8873-9d0dceb0097c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:08.486681 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f1d0797a-8c68-4ca8-909f-f466a2a1ad32 req-b6d0a8f4-85bc-4c57-8873-9d0dceb0097c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0977564 Jun 17 11:02:08.535667 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f1d0797a-8c68-4ca8-909f-f466a2a1ad32 req-5b5b076c-b9ea-494d-8358-9d106989c31b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432522 Jun 17 11:02:09.363121 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b931e3b9-ad82-49ae-ba77-2fd8b8920f63 req-2c1d902d-3014-4387-91c5-e2a8dfab95e0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:09.364550 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b931e3b9-ad82-49ae-ba77-2fd8b8920f63 req-2c1d902d-3014-4387-91c5-e2a8dfab95e0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0601273 Jun 17 11:02:09.401164 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b931e3b9-ad82-49ae-ba77-2fd8b8920f63 req-8f026974-263d-4757-bece-5a61711b5634 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309930 Jun 17 11:02:09.714352 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-799acf43-d5a0-4359-b0e6-a04e819c80fa req-09e58241-00ab-40d7-987d-32ebf419d848 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:09.716091 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-799acf43-d5a0-4359-b0e6-a04e819c80fa req-09e58241-00ab-40d7-987d-32ebf419d848 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0665493 Jun 17 11:02:09.754402 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-799acf43-d5a0-4359-b0e6-a04e819c80fa req-e9448807-4ce1-43e1-a384-cff27c452a2f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319753 Jun 17 11:02:10.575178 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8927e28e-2953-4403-b3e1-413d96b33c88 req-a2652263-1198-4af4-9402-a3d529b79f86 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:10.576553 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8927e28e-2953-4403-b3e1-413d96b33c88 req-a2652263-1198-4af4-9402-a3d529b79f86 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0646632 Jun 17 11:02:10.614015 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8927e28e-2953-4403-b3e1-413d96b33c88 req-2852961c-de8c-485a-802e-1f448b563ac9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319397 Jun 17 11:02:10.815404 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-20f079e2-f13f-49c7-b54f-8ef09de7ad58 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0299652 Jun 17 11:02:10.924989 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a851d5a9-4149-4cb4-aa0e-fd57a75caccc req-57326b40-880e-4aff-ab4f-db449fcd8a52 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:10.926434 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a851d5a9-4149-4cb4-aa0e-fd57a75caccc req-57326b40-880e-4aff-ab4f-db449fcd8a52 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0619645 Jun 17 11:02:10.961371 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a851d5a9-4149-4cb4-aa0e-fd57a75caccc req-fd4a1c69-1e0e-4533-801b-5ff4db6db82e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0294039 Jun 17 11:02:11.788727 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f45cd16e-257b-4cf1-bc8b-865f1b5ddac3 req-c89d6a3b-4f0d-4a5e-bb5d-1023de6bcb96 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:11.790187 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f45cd16e-257b-4cf1-bc8b-865f1b5ddac3 req-c89d6a3b-4f0d-4a5e-bb5d-1023de6bcb96 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0651696 Jun 17 11:02:12.007933 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f45cd16e-257b-4cf1-bc8b-865f1b5ddac3 req-25264bee-7226-4810-b08f-a63627ac0c9b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2118683 Jun 17 11:02:12.164145 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a54bfcd-4ef4-4c55-8e68-97aadefb21df req-b11d92cd-80b0-45a7-91a3-79e4716a5a4b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:12.165560 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0a54bfcd-4ef4-4c55-8e68-97aadefb21df req-b11d92cd-80b0-45a7-91a3-79e4716a5a4b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0607066 Jun 17 11:02:12.201548 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0a54bfcd-4ef4-4c55-8e68-97aadefb21df req-5349b480-14be-460f-b589-79febef0f4a1 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302320 Jun 17 11:02:12.363960 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-7f2aab50-810b-46e2-a890-a55020584a5e service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809846 Jun 17 11:02:12.497964 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb74a99e-a5d0-4689-a12d-4294d5003466 req-c3441034-8547-478e-8c97-08ed855b5319 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832875 Jun 17 11:02:12.968556 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48fdbaf-90be-4d9c-82de-de1528b41509 req-2d6604be-7ba6-4bed-8944-a11fa01822bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:12.970028 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e48fdbaf-90be-4d9c-82de-de1528b41509 req-2d6604be-7ba6-4bed-8944-a11fa01822bf service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 1097 time: 0.0573967 Jun 17 11:02:13.196390 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f4ccdd-45b8-44d9-8404-3772d217d0f8 req-ce493b14-ea24-409a-8c76-824e513b49d2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:13.198244 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-67f4ccdd-45b8-44d9-8404-3772d217d0f8 req-ce493b14-ea24-409a-8c76-824e513b49d2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0688243 Jun 17 11:02:13.245730 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-67f4ccdd-45b8-44d9-8404-3772d217d0f8 req-36aa7c9f-4a3b-4075-ba5d-4aa4b2698199 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405071 Jun 17 11:02:13.295873 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48fdbaf-90be-4d9c-82de-de1528b41509 req-04b3f1cf-0567-4278-8d3f-15c6532cd7d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:13.297348 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e48fdbaf-90be-4d9c-82de-de1528b41509 req-04b3f1cf-0567-4278-8d3f-15c6532cd7d3 service neutron] 10.222.0.25 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 915 time: 0.3175778 Jun 17 11:02:13.342703 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e48fdbaf-90be-4d9c-82de-de1528b41509 req-db21f015-cf0f-4711-ae74-5fce2d263c9c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7f393d5b-3d64-445d-8452-77f330f822c4 HTTP/1.1" status: 200 len: 217 time: 0.0370319 Jun 17 11:02:13.417793 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48fdbaf-90be-4d9c-82de-de1528b41509 req-1e17f12c-44b6-4a9a-9624-d23d56aec3e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:13.419356 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e48fdbaf-90be-4d9c-82de-de1528b41509 req-1e17f12c-44b6-4a9a-9624-d23d56aec3e3 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=c10bc074-5591-4fbf-953f-e4097d48cc79 HTTP/1.1" status: 200 len: 854 time: 0.0689716 Jun 17 11:02:13.455830 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e48fdbaf-90be-4d9c-82de-de1528b41509 req-a373f864-64c6-4bd1-8fdd-171ff49b1701 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0291593 Jun 17 11:02:13.469266 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f7e73dc-cfd8-4201-b724-f547465cd848 req-c68938eb-b9d2-43b3-bbd1-3531207ecd19 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:13.470664 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2f7e73dc-cfd8-4201-b724-f547465cd848 req-c68938eb-b9d2-43b3-bbd1-3531207ecd19 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.1306932 Jun 17 11:02:13.514463 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2f7e73dc-cfd8-4201-b724-f547465cd848 req-9044d103-bee3-4837-acd5-e466f6618f94 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379734 Jun 17 11:02:14.423766 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-669e2f05-a6ea-4bdf-8358-19382269dea8 req-199907bd-0689-4e54-a8cd-18a5b566e4b4 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:14.425125 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-669e2f05-a6ea-4bdf-8358-19382269dea8 req-199907bd-0689-4e54-a8cd-18a5b566e4b4 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0611372 Jun 17 11:02:14.464086 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-669e2f05-a6ea-4bdf-8358-19382269dea8 req-6f8f93c7-d157-422d-b32b-cf0956d0036a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334036 Jun 17 11:02:14.694868 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6542e5-8ea9-4a62-9c54-5f0b4011f203 req-e3e42a43-9fae-4cd6-9008-d0fc0a348b1b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:14.696334 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-af6542e5-8ea9-4a62-9c54-5f0b4011f203 req-e3e42a43-9fae-4cd6-9008-d0fc0a348b1b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0744874 Jun 17 11:02:14.732611 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-af6542e5-8ea9-4a62-9c54-5f0b4011f203 req-38cb5c79-4858-4125-a8d9-c6169e7e85f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306852 Jun 17 11:02:15.051589 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:02:15.636491 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4142a07-61fe-4272-887b-eeee9310e15e req-88eb5cb3-6a61-4897-8c0a-a379a552fea6 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:15.638198 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e4142a07-61fe-4272-887b-eeee9310e15e req-88eb5cb3-6a61-4897-8c0a-a379a552fea6 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0667782 Jun 17 11:02:15.677034 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e4142a07-61fe-4272-887b-eeee9310e15e req-3ec18cd8-18ea-4c14-94b6-cf01a5f92545 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328963 Jun 17 11:02:15.933086 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c554aa08-f971-4c64-985f-61c0f1646b49 req-7a41b1f3-189e-49b6-a593-4045bbad6aeb tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:15.933086 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c554aa08-f971-4c64-985f-61c0f1646b49 req-7a41b1f3-189e-49b6-a593-4045bbad6aeb tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0620883 Jun 17 11:02:15.945292 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c554aa08-f971-4c64-985f-61c0f1646b49 req-6d283245-f5da-4683-bd20-6295f0c16dce tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0343168 Jun 17 11:02:16.355966 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e48fdbaf-90be-4d9c-82de-de1528b41509 req-c020b237-41f3-417b-8c0e-d51ce5a408e9 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825326 Jun 17 11:02:16.843217 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a68ca560-a11b-4149-a731-a895a1e59eec req-23c0d843-ce76-43e0-90d7-edc7e00a1d14 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:16.844685 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a68ca560-a11b-4149-a731-a895a1e59eec req-23c0d843-ce76-43e0-90d7-edc7e00a1d14 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0602708 Jun 17 11:02:16.881216 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a68ca560-a11b-4149-a731-a895a1e59eec req-9201bf37-24f5-4744-b444-1ba8db37e037 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310304 Jun 17 11:02:17.129532 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9137cd17-d4ed-419d-824e-b2144c7a0506 req-f4b0fd4b-4c7a-4396-be08-1e58244c2fc4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:17.130914 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9137cd17-d4ed-419d-824e-b2144c7a0506 req-f4b0fd4b-4c7a-4396-be08-1e58244c2fc4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0652196 Jun 17 11:02:17.166649 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9137cd17-d4ed-419d-824e-b2144c7a0506 req-2eb8050a-1972-4340-84e1-857a818779c4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302975 Jun 17 11:02:18.086205 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e48fdbaf-90be-4d9c-82de-de1528b41509 req-9ecb5ff2-0d22-4d68-914d-39d3416800f0 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1244366 Jun 17 11:02:18.106525 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90154607-d30c-434c-8d28-22c64c2ee6f0 req-f51df04d-b4dd-4236-b0f4-bc2b6983466f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:18.107950 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-90154607-d30c-434c-8d28-22c64c2ee6f0 req-f51df04d-b4dd-4236-b0f4-bc2b6983466f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.1144416 Jun 17 11:02:18.146132 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-90154607-d30c-434c-8d28-22c64c2ee6f0 req-f418eebf-59cf-405b-aed3-a4cf152ba9ed tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323536 Jun 17 11:02:18.347823 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a43a5f-e371-435a-8cde-66f25aeb157c req-22b1e72a-fb75-402b-a416-1b7442b9e3ab tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:18.349309 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-73a43a5f-e371-435a-8cde-66f25aeb157c req-22b1e72a-fb75-402b-a416-1b7442b9e3ab tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0673308 Jun 17 11:02:18.389077 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-73a43a5f-e371-435a-8cde-66f25aeb157c req-569409d8-a118-4875-a3d6-554f03699f3e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340431 Jun 17 11:02:19.336654 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69d219b9-c4f7-4ab5-9a6c-c87bd3def862 req-c0a12f38-b477-423d-84f6-71394e575186 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:19.337915 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-69d219b9-c4f7-4ab5-9a6c-c87bd3def862 req-c0a12f38-b477-423d-84f6-71394e575186 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0692475 Jun 17 11:02:19.375875 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-69d219b9-c4f7-4ab5-9a6c-c87bd3def862 req-e429abb5-b502-4e93-a839-fe04074715ef tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312364 Jun 17 11:02:19.568187 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de2f1a02-f2de-4acb-9899-d3d02598e550 req-fe808169-3ecf-4b4e-9056-e702126d3132 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:19.569709 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-de2f1a02-f2de-4acb-9899-d3d02598e550 req-fe808169-3ecf-4b4e-9056-e702126d3132 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0632701 Jun 17 11:02:19.606088 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-de2f1a02-f2de-4acb-9899-d3d02598e550 req-d6fbe93f-106a-4c05-8f86-28bd88bf03f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308366 Jun 17 11:02:20.202008 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-bea6535f-e0c5-4f59-a90b-496126fbddcb tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1323394398&fields=id&tenant_id=6c4c0226eef34f24a2c7072aba63129d HTTP/1.1" status: 200 len: 267 time: 0.0400174 Jun 17 11:02:20.316615 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-5b8d62af-cbbf-483f-958c-5213867d32b3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:20.318033 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-5b8d62af-cbbf-483f-958c-5213867d32b3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/networks?id=16bcab5c-7033-4cca-98e1-b173b2d78c2f HTTP/1.1" status: 200 len: 807 time: 0.1091692 Jun 17 11:02:20.334986 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-d028f9c4-c7b5-44a3-963f-3bed7bbaa00b tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/quotas/6c4c0226eef34f24a2c7072aba63129d HTTP/1.1" status: 200 len: 375 time: 0.0112844 Jun 17 11:02:20.406203 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-c208e55a-8873-4134-8383-16bb5fe762f4 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=6c4c0226eef34f24a2c7072aba63129d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0647383 Jun 17 11:02:20.523386 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-a40fa6ea-9965-4875-a4ab-c694a70737dc service neutron] 10.222.0.41 "GET /v2.0/networks/16bcab5c-7033-4cca-98e1-b173b2d78c2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0951090 Jun 17 11:02:20.614898 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec2d39d-6a6e-4baa-b0cd-2dd8745197d8 req-f1a51aac-ba74-4827-8090-9667ecd83571 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:20.616386 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4ec2d39d-6a6e-4baa-b0cd-2dd8745197d8 req-f1a51aac-ba74-4827-8090-9667ecd83571 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.1095908 Jun 17 11:02:20.620252 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-efc8a63a-322d-46e9-9696-f9458d01415d service neutron] 10.222.0.41 "GET /v2.0/networks/16bcab5c-7033-4cca-98e1-b173b2d78c2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0908165 Jun 17 11:02:20.627497 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-5dd3e3c1-40ab-4744-82ee-f97885885541 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:20.664508 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4ec2d39d-6a6e-4baa-b0cd-2dd8745197d8 req-b3196b2f-1ac9-4d5c-a162-51df2afaf14c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402882 Jun 17 11:02:21.006779 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3b746e9-afe8-4f17-ae9b-ca8fcee5d29a req-20e60c84-8e03-4dd9-a355-8a174affc033 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:21.008554 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b3b746e9-afe8-4f17-ae9b-ca8fcee5d29a req-20e60c84-8e03-4dd9-a355-8a174affc033 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0864286 Jun 17 11:02:21.045322 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b3b746e9-afe8-4f17-ae9b-ca8fcee5d29a req-d417b668-6960-4caf-9f91-c5340d3445c7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311100 Jun 17 11:02:21.301614 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1f63422e-56a9-4b4f-9581-9834e4d11a3c req-3b4a77d9-b475-4559-96e3-f716fb9981bb tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 210 time: 0.0403125 Jun 17 11:02:21.374306 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 35994) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:21.413942 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 35998) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:21.523209 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-80abc420-c360-4796-9b77-7901c21db673 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:21.524373 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c5758b11-e3f4-4a47-867c-9ec4e88f51f7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:21.544204 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.db.api [None req-c5758b11-e3f4-4a47-867c-9ec4e88f51f7 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Jun 17 11:02:21.544204 dv-cinder-773870-6-iscsi neutron-server[110215]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Jun 17 11:02:21.544204 dv-cinder-773870-6-iscsi neutron-server[110215]: [parameters: {'project_id': 'b226796d731e4b28aef048b5e49e6c1f', 'id': '476e252c-9c6d-40ac-8b56-a2c1087e306e', 'expiration': datetime.datetime(2021, 6, 17, 11, 4, 21, 540805)}] Jun 17 11:02:21.544204 dv-cinder-773870-6-iscsi neutron-server[110215]: (Background on this error at: http://sqlalche.me/e/14/e3q8) {{(pid=110215) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Jun 17 11:02:21.544769 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_db.api [None req-c5758b11-e3f4-4a47-867c-9ec4e88f51f7 admin admin] Performing DB retry for function neutron.db.securitygroups_db.SecurityGroupDbMixin.create_security_group {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jun 17 11:02:21.615959 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-80abc420-c360-4796-9b77-7901c21db673 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:21.666658 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-80abc420-c360-4796-9b77-7901c21db673 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:21.689542 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e76b389c-6a37-41ac-91e1-b2ea70e1abd3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:21.709209 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-80abc420-c360-4796-9b77-7901c21db673 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=32aacad836754aefbd4586f275a60459&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3337996 Jun 17 11:02:21.711211 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80abc420-c360-4796-9b77-7901c21db673 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44d184f9-0668-479d-9180-0538f548b0e3,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:21.711884 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 36006) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:21.717350 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-80abc420-c360-4796-9b77-7901c21db673 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:21.762995 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-df5ba3e7-5609-4e6f-8038-832601a26c89 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:21.813487 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-df5ba3e7-5609-4e6f-8038-832601a26c89 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:21.871153 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980a0603-1e8f-48f5-b330-3c0052e3ab48 req-c9c46c24-6a36-4582-8563-bf7a0699d538 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:21.872943 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-980a0603-1e8f-48f5-b330-3c0052e3ab48 req-c9c46c24-6a36-4582-8563-bf7a0699d538 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0995045 Jun 17 11:02:21.913549 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-980a0603-1e8f-48f5-b330-3c0052e3ab48 req-73e2608f-9058-4244-a053-56cfb955fa43 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329759 Jun 17 11:02:21.946793 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-df5ba3e7-5609-4e6f-8038-832601a26c89 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:21.949543 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-df5ba3e7-5609-4e6f-8038-832601a26c89 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:21.951094 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-df5ba3e7-5609-4e6f-8038-832601a26c89 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/44d184f9-0668-479d-9180-0538f548b0e3 HTTP/1.1" status: 204 len: 168 time: 0.2378139 Jun 17 11:02:21.951847 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f5a713e5-5ad7-444e-a2c1-35107abda7a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:21.959203 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df5ba3e7-5609-4e6f-8038-832601a26c89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44d184f9-0668-479d-9180-0538f548b0e3,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:21.961755 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-df5ba3e7-5609-4e6f-8038-832601a26c89 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:22.045615 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c5758b11-e3f4-4a47-867c-9ec4e88f51f7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.147881 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c5758b11-e3f4-4a47-867c-9ec4e88f51f7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.224827 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0244430-73f4-42a7-8c0b-043a173d9217 req-0bd9d7e9-6836-43e3-88cc-9ef8d505755e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:22.226325 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f0244430-73f4-42a7-8c0b-043a173d9217 req-0bd9d7e9-6836-43e3-88cc-9ef8d505755e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0647523 Jun 17 11:02:22.227512 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c5758b11-e3f4-4a47-867c-9ec4e88f51f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.231588 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-554b2939-9860-43ed-ae11-122fc131b3c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:22.278252 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-c5758b11-e3f4-4a47-867c-9ec4e88f51f7 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=b226796d731e4b28aef048b5e49e6c1f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8630993 Jun 17 11:02:22.280867 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 36018) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:22.299204 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5758b11-e3f4-4a47-867c-9ec4e88f51f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48ec2926-46fe-4c14-9204-cc22980e7873,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:22.305190 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f0244430-73f4-42a7-8c0b-043a173d9217 req-e967d7ce-a349-41b6-8e42-3352577faf63 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658956 Jun 17 11:02:22.305757 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c5758b11-e3f4-4a47-867c-9ec4e88f51f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:22.353328 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b8af3fa3-8c72-419b-9832-593f5f72737b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.376347 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b8af3fa3-8c72-419b-9832-593f5f72737b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.450868 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-320c567b-7c44-40d9-8c01-c5c35afbc3b5 req-9deddbfd-5f68-4c60-bebd-2e0f837d7796 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 210 time: 0.0313978 Jun 17 11:02:22.455286 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b8af3fa3-8c72-419b-9832-593f5f72737b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.458039 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b8af3fa3-8c72-419b-9832-593f5f72737b admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.461839 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-b8af3fa3-8c72-419b-9832-593f5f72737b admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/48ec2926-46fe-4c14-9204-cc22980e7873 HTTP/1.1" status: 204 len: 168 time: 0.1768417 Jun 17 11:02:22.461839 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a2a88970-d5ff-47da-9c04-2f1537cd1588 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:22.467930 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8af3fa3-8c72-419b-9832-593f5f72737b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48ec2926-46fe-4c14-9204-cc22980e7873,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:22.481244 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b8af3fa3-8c72-419b-9832-593f5f72737b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:22.506838 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 36026) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:22.523558 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-eed35a39-5007-4c21-bd69-c14faed32a97 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.611376 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-eed35a39-5007-4c21-bd69-c14faed32a97 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.661188 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-eed35a39-5007-4c21-bd69-c14faed32a97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.663662 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-783fefd9-0408-43f6-97e4-6ce48667ecde admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:22.703969 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed35a39-5007-4c21-bd69-c14faed32a97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ced7fb3c-89da-4906-93ee-5f97e6857541,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:22.707564 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-eed35a39-5007-4c21-bd69-c14faed32a97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:22.714468 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-eed35a39-5007-4c21-bd69-c14faed32a97 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=ea59ec516e644e17857c04c094c96cef&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2040434 Jun 17 11:02:22.716248 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 36032) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:22.765206 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b7779081-e10e-4779-985e-71ff77ac646d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.788686 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b7779081-e10e-4779-985e-71ff77ac646d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.912540 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b7779081-e10e-4779-985e-71ff77ac646d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.915181 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b7779081-e10e-4779-985e-71ff77ac646d admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:22.923210 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-b7779081-e10e-4779-985e-71ff77ac646d admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/ced7fb3c-89da-4906-93ee-5f97e6857541 HTTP/1.1" status: 204 len: 168 time: 0.1991940 Jun 17 11:02:22.923210 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-2e024069-b1e0-493c-8027-23fe41504e9f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:22.925778 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7779081-e10e-4779-985e-71ff77ac646d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ced7fb3c-89da-4906-93ee-5f97e6857541,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:22.928607 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-b7779081-e10e-4779-985e-71ff77ac646d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:23.096465 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76456a52-6d39-4f89-9a28-44eed8733477 req-f2eebfbb-521d-4deb-89cf-b88dffc2d8e7 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:23.097927 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-76456a52-6d39-4f89-9a28-44eed8733477 req-f2eebfbb-521d-4deb-89cf-b88dffc2d8e7 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0625789 Jun 17 11:02:23.133034 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 36038) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:23.144531 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-76456a52-6d39-4f89-9a28-44eed8733477 req-95079c0d-3198-40cc-b929-9baf87c6f5c7 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396123 Jun 17 11:02:23.149957 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6fa84391-e9f4-4642-a428-d6d1eca986be admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:23.253379 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6fa84391-e9f4-4642-a428-d6d1eca986be admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:23.306959 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6fa84391-e9f4-4642-a428-d6d1eca986be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:23.309445 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-aa91fdb1-6259-4fbc-9c43-4a4f74ded356 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:23.324478 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-b0ee14d9-b56f-4985-8325-2ef9062ad9a1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:23.348836 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fa84391-e9f4-4642-a428-d6d1eca986be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=703da937-3666-478a-9df2-8b6e091c5632,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:23.352213 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6fa84391-e9f4-4642-a428-d6d1eca986be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:23.358577 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 36050) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:23.366923 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-6fa84391-e9f4-4642-a428-d6d1eca986be admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=01ea7425b42144b78de2ec4d68cf3a11&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2328055 Jun 17 11:02:23.370836 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 7f393d5b-3d64-445d-8452-77f330f822c4 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:02:23.453958 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7fb3818c-3c2f-4f2d-8c7f-c1292c6e0089 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:23.478283 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7fb3818c-3c2f-4f2d-8c7f-c1292c6e0089 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:23.504352 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 7f393d5b-3d64-445d-8452-77f330f822c4, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=7f393d5b-3d64-445d-8452-77f330f822c4,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:02:23.521136 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '7f393d5b-3d64-445d-8452-77f330f822c4', 'network_id': 'bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b', 'port_id': '7f393d5b-3d64-445d-8452-77f330f822c4', 'mac_address': 'fa:16:3e:b0:5a:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c10bc074-5591-4fbf-953f-e4097d48cc79', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:02:23.531813 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a92bac3-14f3-435b-a22b-c72d423f7d17 req-093504fe-fe73-4425-a570-d18571dca641 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:23.535237 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4a92bac3-14f3-435b-a22b-c72d423f7d17 req-093504fe-fe73-4425-a570-d18571dca641 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 944 time: 0.0792525 Jun 17 11:02:23.573637 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:23.575707 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7fb3818c-3c2f-4f2d-8c7f-c1292c6e0089 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:23.576845 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4a92bac3-14f3-435b-a22b-c72d423f7d17 req-0b0537e8-cf9a-41fd-ad42-703117ac9f2a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0348992 Jun 17 11:02:23.579856 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-7fb3818c-3c2f-4f2d-8c7f-c1292c6e0089 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:23.590814 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7f393d5b-3d64-445d-8452-77f330f822c4 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:02:23.597679 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-7fb3818c-3c2f-4f2d-8c7f-c1292c6e0089 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/703da937-3666-478a-9df2-8b6e091c5632 HTTP/1.1" status: 204 len: 168 time: 0.2269850 Jun 17 11:02:23.598220 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-ac7e2bec-8263-40ea-b41c-17115f6c116f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:23.615778 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 7f393d5b-3d64-445d-8452-77f330f822c4, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=7f393d5b-3d64-445d-8452-77f330f822c4,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:02:23.617704 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:23.626243 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb3818c-3c2f-4f2d-8c7f-c1292c6e0089 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=703da937-3666-478a-9df2-8b6e091c5632,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:23.634401 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-7fb3818c-3c2f-4f2d-8c7f-c1292c6e0089 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:23.701510 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:23.704231 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2658669d-fa3a-4438-a43a-6d5f5dcdd90c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:23.759642 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=7f393d5b-3d64-445d-8452-77f330f822c4,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:23.759815 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-55c80af8-f288-46c2-a339-ddc3693a092c req-e6a1e75a-4137-422a-9a16-4b24663ad5a0 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 210 time: 0.0388422 Jun 17 11:02:23.763595 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:24.179626 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 36086) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:24.195864 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-45c20de2-b469-493b-97b1-6ec1e65d2835 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:24.296338 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-45c20de2-b469-493b-97b1-6ec1e65d2835 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:24.333755 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08fb2952-3311-4cd3-b87f-81bee0f204d5 req-1688c666-b91e-46fd-8ef8-a1fce2b8deaf tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:24.335218 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-08fb2952-3311-4cd3-b87f-81bee0f204d5 req-1688c666-b91e-46fd-8ef8-a1fce2b8deaf tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0671792 Jun 17 11:02:24.369683 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-45c20de2-b469-493b-97b1-6ec1e65d2835 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:24.373477 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b8af3fa3-8c72-419b-9832-593f5f72737b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:24.390741 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-08fb2952-3311-4cd3-b87f-81bee0f204d5 req-6e2a695a-8218-4727-b506-e90298ff954c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448258 Jun 17 11:02:24.415641 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:24.420585 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-45c20de2-b469-493b-97b1-6ec1e65d2835 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=2b817383463b4348898e030f2dc5fc76&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2404459 Jun 17 11:02:24.423377 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c20de2-b469-493b-97b1-6ec1e65d2835 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d2f2af3-7e7c-4d55-ad52-1b79a2d964ec,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:24.423994 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 36116) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:24.426557 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-45c20de2-b469-493b-97b1-6ec1e65d2835 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:24.478378 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-06360ce0-50a4-44a9-9df5-14b2b8802529 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:24.499654 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-06360ce0-50a4-44a9-9df5-14b2b8802529 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:24.604228 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-06360ce0-50a4-44a9-9df5-14b2b8802529 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:24.606873 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-06360ce0-50a4-44a9-9df5-14b2b8802529 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:24.608012 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-06360ce0-50a4-44a9-9df5-14b2b8802529 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/9d2f2af3-7e7c-4d55-ad52-1b79a2d964ec HTTP/1.1" status: 204 len: 168 time: 0.1830099 Jun 17 11:02:24.608876 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-36393ddd-8ba0-4e7c-9924-7b890298a008 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:24.617848 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06360ce0-50a4-44a9-9df5-14b2b8802529 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d2f2af3-7e7c-4d55-ad52-1b79a2d964ec,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:24.625708 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-06360ce0-50a4-44a9-9df5-14b2b8802529 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:24.786425 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95642f00-07ed-4569-8cc5-aec1af9f17a2 req-114eb612-ca77-4db2-8a7f-4fecbc3d4e36 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:24.788286 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-95642f00-07ed-4569-8cc5-aec1af9f17a2 req-114eb612-ca77-4db2-8a7f-4fecbc3d4e36 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0706656 Jun 17 11:02:24.833462 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-95642f00-07ed-4569-8cc5-aec1af9f17a2 req-1983dff6-1279-48e5-a48f-055087ec5b55 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381880 Jun 17 11:02:24.979806 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b7f97f8c-a3d1-47de-bf5f-aafa9645ae40 req-f64ea7fb-644d-4f8f-9688-cae79f326e78 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 210 time: 0.0338259 Jun 17 11:02:25.570740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726e2a3e-9bd9-46e3-84c1-92a24208dd67 req-3f4bd80d-f309-4a22-b188-1de39f21cc11 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:25.572225 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-726e2a3e-9bd9-46e3-84c1-92a24208dd67 req-3f4bd80d-f309-4a22-b188-1de39f21cc11 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0675290 Jun 17 11:02:25.610150 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-726e2a3e-9bd9-46e3-84c1-92a24208dd67 req-f7e7cac8-5236-4e59-b4f1-a10e0782ad47 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320172 Jun 17 11:02:26.036241 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9e50d79-4b15-4726-bdb7-d77a0b8e80b6 req-dafa4f5e-df61-4e0f-8f8f-76d911925b64 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:26.037606 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d9e50d79-4b15-4726-bdb7-d77a0b8e80b6 req-dafa4f5e-df61-4e0f-8f8f-76d911925b64 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0670557 Jun 17 11:02:26.074785 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d9e50d79-4b15-4726-bdb7-d77a0b8e80b6 req-3a2dec72-5f06-45e9-9ed3-5416b6fb0569 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317247 Jun 17 11:02:26.209439 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fef0daaf-f345-4979-a835-947419619912 req-cd2c41bf-2380-4127-9dfa-16766b3ec678 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 210 time: 0.0337119 Jun 17 11:02:26.290374 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 36172) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:26.405012 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-085c730b-2f4e-47ff-b46c-698997f4ed6f admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:26.491797 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-085c730b-2f4e-47ff-b46c-698997f4ed6f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:26.541567 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-085c730b-2f4e-47ff-b46c-698997f4ed6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:26.546097 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-22f505f5-f76f-471f-8d86-28a8c56706f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:26.587469 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-085c730b-2f4e-47ff-b46c-698997f4ed6f admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=d3d1cd7286824f2385aab451074ce6ff&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2958226 Jun 17 11:02:26.589037 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-085c730b-2f4e-47ff-b46c-698997f4ed6f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69e33377-4d84-4866-a4e3-74efcf2d2099,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:26.590405 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 36178) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:26.592903 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-085c730b-2f4e-47ff-b46c-698997f4ed6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:26.647171 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-52874f9a-3b7d-4404-89df-e56a6f164917 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:26.669887 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-52874f9a-3b7d-4404-89df-e56a6f164917 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:26.782582 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:26.810320 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-52874f9a-3b7d-4404-89df-e56a6f164917 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:26.812970 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-52874f9a-3b7d-4404-89df-e56a6f164917 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:26.814117 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-52874f9a-3b7d-4404-89df-e56a6f164917 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/69e33377-4d84-4866-a4e3-74efcf2d2099 HTTP/1.1" status: 204 len: 168 time: 0.2224317 Jun 17 11:02:26.818499 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:26.829137 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52874f9a-3b7d-4404-89df-e56a6f164917 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69e33377-4d84-4866-a4e3-74efcf2d2099,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:26.837935 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6359ad50-1077-451b-aafb-13232393284e req-9e601d54-01dd-43b1-a81d-74377fdf5e4f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:26.843371 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6359ad50-1077-451b-aafb-13232393284e req-9e601d54-01dd-43b1-a81d-74377fdf5e4f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0915046 Jun 17 11:02:26.845104 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-52874f9a-3b7d-4404-89df-e56a6f164917 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:26.881997 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6359ad50-1077-451b-aafb-13232393284e req-6bdc7225-6206-47b2-89e0-590e15d49cb8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353272 Jun 17 11:02:27.303355 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c823b04c-af27-4edc-9ed9-017c0fb24006 req-cca854cc-0da8-4026-bbeb-58c652ac8277 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:27.306269 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c823b04c-af27-4edc-9ed9-017c0fb24006 req-cca854cc-0da8-4026-bbeb-58c652ac8277 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.1001601 Jun 17 11:02:27.355259 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c823b04c-af27-4edc-9ed9-017c0fb24006 req-cfe0677e-5786-46fa-bc84-350fcbe59311 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431185 Jun 17 11:02:27.380243 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3d516a4a-533d-471e-ad27-031895a5ab2f req-5e3f312d-31da-48f9-a820-80ac0ea876ae tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 210 time: 0.0295279 Jun 17 11:02:27.799422 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['7f393d5b-3d64-445d-8452-77f330f822c4'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:02:28.001812 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-5215a05a-0d98-4dba-a6fa-67c30ca70b40 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:28.003290 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-5215a05a-0d98-4dba-a6fa-67c30ca70b40 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.25 "GET /v2.0/networks?id=16bcab5c-7033-4cca-98e1-b173b2d78c2f HTTP/1.1" status: 200 len: 807 time: 0.1170778 Jun 17 11:02:28.068283 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a84dab-16cf-44fc-946b-d5069671374d req-46429d0f-8831-42ac-8030-797822a25584 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:28.069844 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-65a84dab-16cf-44fc-946b-d5069671374d req-46429d0f-8831-42ac-8030-797822a25584 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0656784 Jun 17 11:02:28.108729 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-65a84dab-16cf-44fc-946b-d5069671374d req-14c6bde7-ffe4-4f43-a2c7-39928e8128df tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332017 Jun 17 11:02:28.208782 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-b2d9c1b6-1f1f-4914-ac52-c6d6e51ca4d9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c4c0226eef34f24a2c7072aba63129d HTTP/1.1" status: 200 len: 380 time: 0.0470693 Jun 17 11:02:28.218258 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Request body: {'port': {'device_id': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'admin_state_up': True, 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'security_groups': ['bccb0152-196e-4e75-b2d0-57c36443b0bc']}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:02:28.427568 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Made reservation on behalf of 6c4c0226eef34f24a2c7072aba63129d for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:02:28.434185 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:28.547200 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9cc5aa4-7d08-4a37-93db-2a8b950654cd req-8153922e-b913-43e6-be17-10e064395935 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 210 time: 0.0414484 Jun 17 11:02:28.584761 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a317e4ce-7d75-416d-9d57-cfe53e29a7e0 req-72f08b77-8ef0-4f5d-af17-6f7754435f06 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:28.586250 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a317e4ce-7d75-416d-9d57-cfe53e29a7e0 req-72f08b77-8ef0-4f5d-af17-6f7754435f06 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0796635 Jun 17 11:02:28.627074 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a317e4ce-7d75-416d-9d57-cfe53e29a7e0 req-1da6b41d-b60a-47ef-b80c-0412722089ea tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313797 Jun 17 11:02:28.627324 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Allocated IP 172.20.0.7 (16bcab5c-7033-4cca-98e1-b173b2d78c2f/2567fd48-9bd6-4ffa-9d4c-72f989266554/3084d465-862a-4dca-ba25-6a98d0b14fbb) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:02:28.768131 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:28.788528 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Transition to ACTIVE for port object 3084d465-862a-4dca-ba25-6a98d0b14fbb will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:02:28.861839 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:28.868599 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-db81657c-706d-46d6-89ad-3d83357c24b1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:28.920568 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Network 16bcab5c-7033-4cca-98e1-b173b2d78c2f is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:02:28.924087 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:02:28.932352 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:02:28.967401 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event updated for resources: {'Port': ['ID=3084d465-862a-4dca-ba25-6a98d0b14fbb,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:28.973923 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:29.007211 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:29.015055 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:29.143155 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9284222 Jun 17 11:02:29.155713 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Request body: {'port': {'device_id': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:02:29.233098 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-ebfea2df-e156-493d-9c09-d6293050a379 None None] Provisioning for port 3084d465-862a-4dca-ba25-6a98d0b14fbb completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:02:29.238180 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-ebfea2df-e156-493d-9c09-d6293050a379 None None] Provisioning complete for port 3084d465-862a-4dca-ba25-6a98d0b14fbb triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:02:29.238437 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-ebfea2df-e156-493d-9c09-d6293050a379 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:29.262734 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:29.283435 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-ebfea2df-e156-493d-9c09-d6293050a379 None None] Port 3084d465-862a-4dca-ba25-6a98d0b14fbb cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:02:29.310393 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ec2557-98fa-411b-a541-063c97a90e99 req-79af3ba1-96b4-4904-8bcb-c9dc53468dd9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:29.311889 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-12ec2557-98fa-411b-a541-063c97a90e99 req-79af3ba1-96b4-4904-8bcb-c9dc53468dd9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0907180 Jun 17 11:02:29.363839 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-12ec2557-98fa-411b-a541-063c97a90e99 req-2e725aff-6442-4f17-9357-b1c59716f6db tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460622 Jun 17 11:02:29.542330 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3084d465-862a-4dca-ba25-6a98d0b14fbb {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:02:29.550154 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:29.565246 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Transition to ACTIVE for port object 3084d465-862a-4dca-ba25-6a98d0b14fbb will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:02:29.615416 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:29.617478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:29.674606 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Pushing event updated for resources: {'Port': ['ID=3084d465-862a-4dca-ba25-6a98d0b14fbb,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:29.679724 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:29.838826 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3787b02-0d64-4a0d-bf53-90e19d8afe2b req-5cbc6a5a-23cc-467e-a812-c36195d624a5 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:29.846443 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d3787b02-0d64-4a0d-bf53-90e19d8afe2b req-5cbc6a5a-23cc-467e-a812-c36195d624a5 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0819066 Jun 17 11:02:29.893129 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d3787b02-0d64-4a0d-bf53-90e19d8afe2b req-87031300-5ce8-4e2b-9b04-b5d43148a997 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456731 Jun 17 11:02:29.907604 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b81ced-ef40-4f96-9a49-00d465da8054 req-afa5acc6-31ce-45fc-8183-bb8550196199 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:29.911473 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-50b81ced-ef40-4f96-9a49-00d465da8054 req-afa5acc6-31ce-45fc-8183-bb8550196199 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.1717570 Jun 17 11:02:29.912482 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Attempting to bind port 3084d465-862a-4dca-ba25-6a98d0b14fbb on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:02:29.912886 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Attempting to bind port 3084d465-862a-4dca-ba25-6a98d0b14fbb by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:02:29.915415 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Attempting to bind port 3084d465-862a-4dca-ba25-6a98d0b14fbb on network 16bcab5c-7033-4cca-98e1-b173b2d78c2f {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:02:29.924266 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Port 3084d465-862a-4dca-ba25-6a98d0b14fbb on network 16bcab5c-7033-4cca-98e1-b173b2d78c2f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:02:29.924578 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Attempting to bind port 3084d465-862a-4dca-ba25-6a98d0b14fbb on network 16bcab5c-7033-4cca-98e1-b173b2d78c2f {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:02:29.942165 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 2, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:02:29.942498 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Checking segment: {'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:02:29.943513 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Bound using segment: {'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:02:29.944154 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Bound port: 3084d465-862a-4dca-ba25-6a98d0b14fbb, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '61eb1f0e-3387-4796-865e-caeb701082e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:02:29.945210 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:29.974728 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-50b81ced-ef40-4f96-9a49-00d465da8054 req-223a59db-cb9c-44bf-8376-e79cd3e48d53 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0578308 Jun 17 11:02:30.025877 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] For port 3084d465-862a-4dca-ba25-6a98d0b14fbb, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:02:30.029337 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] For port 3084d465-862a-4dca-ba25-6a98d0b14fbb, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=3084d465-862a-4dca-ba25-6a98d0b14fbb,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:02:30.101890 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:30.104886 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c0df3a58-0d63-4f19-a966-c2f1f0f2a2d3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:30.134776 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:30.135405 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:30.136847 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] 10.222.0.25 "PUT /v2.0/ports/3084d465-862a-4dca-ba25-6a98d0b14fbb HTTP/1.1" status: 200 len: 1093 time: 0.9857383 Jun 17 11:02:30.137359 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'tag': '3084d465-862a-4dca-ba25-6a98d0b14fbb'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:02:30.139634 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe5895b3-98cc-423b-bf96-5a2f6c79cff1" -d '{"events": [{"name": "network-changed", "server_uuid": "2bdbe412-bb25-418e-87ac-7edfc51cf3af", "tag": "3084d465-862a-4dca-ba25-6a98d0b14fbb"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:02:30.169749 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Pushing event updated for resources: {'Port': ['ID=3084d465-862a-4dca-ba25-6a98d0b14fbb,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:30.173513 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:30.327397 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:02:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-67dd96b3-9b00-49eb-b8fe-168387e558d5 x-openstack-request-id: req-67dd96b3-9b00-49eb-b8fe-168387e558d5 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:02:30.327720 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2bdbe412-bb25-418e-87ac-7edfc51cf3af", "tag": "3084d465-862a-4dca-ba25-6a98d0b14fbb", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:02:30.328009 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-67dd96b3-9b00-49eb-b8fe-168387e558d5 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:02:30.328529 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'tag': '3084d465-862a-4dca-ba25-6a98d0b14fbb', 'status': 'completed', 'code': 200} Jun 17 11:02:30.544029 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90322aac-1188-42fb-b9ff-459d3493d9c6 req-e40ca689-6c41-418c-b8e4-54e9c12f0539 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:30.545498 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-90322aac-1188-42fb-b9ff-459d3493d9c6 req-e40ca689-6c41-418c-b8e4-54e9c12f0539 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0676160 Jun 17 11:02:30.583183 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-90322aac-1188-42fb-b9ff-459d3493d9c6 req-92dddce6-fa6a-4250-a1ad-67f3ed5a5aab tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306807 Jun 17 11:02:31.057681 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d9852d-dad9-4323-a5a6-f8116ace7113 req-3d5eaaee-6fe4-484c-a3e0-1f5ba38bba4a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:31.059280 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-04d9852d-dad9-4323-a5a6-f8116ace7113 req-3d5eaaee-6fe4-484c-a3e0-1f5ba38bba4a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0626762 Jun 17 11:02:31.097961 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-04d9852d-dad9-4323-a5a6-f8116ace7113 req-e96723e3-2e03-4225-a99b-3e1322bf79e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329611 Jun 17 11:02:31.263656 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec22972-c92e-45a1-99e9-de9b58d4f716 req-d38b6bed-cd6e-44ac-b311-d598741d2cf2 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:31.265024 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-eec22972-c92e-45a1-99e9-de9b58d4f716 req-d38b6bed-cd6e-44ac-b311-d598741d2cf2 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0625119 Jun 17 11:02:31.303476 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-eec22972-c92e-45a1-99e9-de9b58d4f716 req-e93e5573-9bb2-4fbd-a976-ae593f161b55 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322261 Jun 17 11:02:31.761379 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b4c009-f290-4ef0-9cc7-f0a5178c4dcb req-f5c213a0-1337-44ba-ac8e-e20e49e72b5c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:31.763049 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-22b4c009-f290-4ef0-9cc7-f0a5178c4dcb req-f5c213a0-1337-44ba-ac8e-e20e49e72b5c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0679841 Jun 17 11:02:31.802858 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-22b4c009-f290-4ef0-9cc7-f0a5178c4dcb req-51043302-b795-4df7-88ee-c75e4ac8f64e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0343137 Jun 17 11:02:32.274176 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5b7b3d-eead-4d3f-9cd4-d35f9ed33de3 req-41e0b9e0-5627-4040-88e7-21167c045526 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:32.275555 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ab5b7b3d-eead-4d3f-9cd4-d35f9ed33de3 req-41e0b9e0-5627-4040-88e7-21167c045526 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0625463 Jun 17 11:02:32.319393 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ab5b7b3d-eead-4d3f-9cd4-d35f9ed33de3 req-67114e5a-7611-4845-9094-29a9de099916 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383332 Jun 17 11:02:32.489467 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9438b16-a8d5-4794-90d0-5c784fbf8a6c req-c89d7143-ae0b-4abb-a654-7401c0bcf87a tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:32.490956 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d9438b16-a8d5-4794-90d0-5c784fbf8a6c req-c89d7143-ae0b-4abb-a654-7401c0bcf87a tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0721090 Jun 17 11:02:32.528387 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d9438b16-a8d5-4794-90d0-5c784fbf8a6c req-a7eb33c6-570a-4a43-9f8d-464bfd34e6f7 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317185 Jun 17 11:02:32.979012 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dc46d6-6477-4136-b5ea-c8df14d9f0db req-9d362019-8f75-4d36-ba4e-c7e4af7765bf tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:32.980463 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a2dc46d6-6477-4136-b5ea-c8df14d9f0db req-9d362019-8f75-4d36-ba4e-c7e4af7765bf tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0640638 Jun 17 11:02:33.019006 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a2dc46d6-6477-4136-b5ea-c8df14d9f0db req-b22345d5-ce3d-4d40-a4f8-e10a078fc9f2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313859 Jun 17 11:02:33.495394 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8b01e1b-5461-4347-9aba-f65e9680197a req-214b67b3-0672-4e14-9cd3-2fdd27a2f91a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:33.496828 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e8b01e1b-5461-4347-9aba-f65e9680197a req-214b67b3-0672-4e14-9cd3-2fdd27a2f91a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0640578 Jun 17 11:02:33.534678 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e8b01e1b-5461-4347-9aba-f65e9680197a req-568ca590-9305-42f9-8d06-5f28d3a7d463 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310853 Jun 17 11:02:33.712966 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d84ee78-1dd1-46cc-b0fa-f951cce31f6b req-4f4e80f6-2ae8-4d2e-84fc-f6b887645277 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:33.714415 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4d84ee78-1dd1-46cc-b0fa-f951cce31f6b req-4f4e80f6-2ae8-4d2e-84fc-f6b887645277 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0705404 Jun 17 11:02:33.750662 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4d84ee78-1dd1-46cc-b0fa-f951cce31f6b req-102c16f2-260e-47cd-b2d5-750718c8e664 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0299752 Jun 17 11:02:34.190860 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c013c6-9cf5-48dc-a597-41fdac6cea08 req-1d7f0199-f6a3-44a4-9ad9-823f187425a2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:34.192344 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-69c013c6-9cf5-48dc-a597-41fdac6cea08 req-1d7f0199-f6a3-44a4-9ad9-823f187425a2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0625789 Jun 17 11:02:34.228825 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-69c013c6-9cf5-48dc-a597-41fdac6cea08 req-4afe36e8-8654-4532-a69d-83d658bc5d9b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309000 Jun 17 11:02:34.721881 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983ac5f8-979c-4d56-ae8e-ad6a7fd90476 req-fd4ef587-1a61-4c7d-9486-aeed431f04f4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:34.723364 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-983ac5f8-979c-4d56-ae8e-ad6a7fd90476 req-fd4ef587-1a61-4c7d-9486-aeed431f04f4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0676038 Jun 17 11:02:34.989309 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-983ac5f8-979c-4d56-ae8e-ad6a7fd90476 req-41d8e230-553f-454e-a27e-99c09a3cb09c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2603228 Jun 17 11:02:35.149175 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a67b142-79ac-494a-be7d-59fe65632402 req-03096b93-6c0e-4bfe-8826-fd8b5bc98028 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:35.150618 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7a67b142-79ac-494a-be7d-59fe65632402 req-03096b93-6c0e-4bfe-8826-fd8b5bc98028 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0614598 Jun 17 11:02:35.187250 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7a67b142-79ac-494a-be7d-59fe65632402 req-2e374bd5-9a80-49ee-937f-189bdcb73866 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308220 Jun 17 11:02:35.416244 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83356ab5-0768-4871-b055-a02ba2a4245f req-011775c6-1ba7-4c72-ac53-840e90a60659 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:35.417769 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83356ab5-0768-4871-b055-a02ba2a4245f req-011775c6-1ba7-4c72-ac53-840e90a60659 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0699983 Jun 17 11:02:35.458474 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83356ab5-0768-4871-b055-a02ba2a4245f req-dcbda0f7-28b0-4600-a90d-f97f50e626bc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344584 Jun 17 11:02:35.982141 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5895b3-98cc-423b-bf96-5a2f6c79cff1 req-21244160-cad5-42d1-a6a5-d01b95e8aef6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:35.983654 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fe5895b3-98cc-423b-bf96-5a2f6c79cff1 req-21244160-cad5-42d1-a6a5-d01b95e8aef6 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=6c4c0226eef34f24a2c7072aba63129d&device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 1096 time: 0.0551543 Jun 17 11:02:36.165743 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828f0427-9ed3-4e97-9603-616046dee71d req-ccc1fa52-49a6-4bd1-a196-215d72d9db7f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:36.167372 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-828f0427-9ed3-4e97-9603-616046dee71d req-ccc1fa52-49a6-4bd1-a196-215d72d9db7f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0629144 Jun 17 11:02:36.206862 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-828f0427-9ed3-4e97-9603-616046dee71d req-0121cc63-87b8-4f40-b088-574144afa4a1 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326467 Jun 17 11:02:36.365566 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-839753dd-d1e6-41a8-a426-d3e88476e198 req-b4d175cf-b1ab-47fd-84df-acedcf3df101 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:36.367060 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-839753dd-d1e6-41a8-a426-d3e88476e198 req-b4d175cf-b1ab-47fd-84df-acedcf3df101 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0665357 Jun 17 11:02:36.408136 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-839753dd-d1e6-41a8-a426-d3e88476e198 req-b2cb4dc5-1595-47c5-aa7d-7e36944f279a tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0351932 Jun 17 11:02:36.655364 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19cd111f-4fca-45ed-895b-cee0d57ef1f4 req-c824b7cc-fa66-452d-a0fc-51cf3ca6ab80 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:36.657321 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-19cd111f-4fca-45ed-895b-cee0d57ef1f4 req-c824b7cc-fa66-452d-a0fc-51cf3ca6ab80 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0785203 Jun 17 11:02:36.698220 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-19cd111f-4fca-45ed-895b-cee0d57ef1f4 req-e84bb74c-0d44-4e4d-8388-81777b46abf0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352461 Jun 17 11:02:36.798741 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:37.379297 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e101dcd3-9ddc-494b-9cd0-4413ad548760 req-1295ec1e-d8cf-4d8c-9940-9ae82c6c5671 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:37.380770 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e101dcd3-9ddc-494b-9cd0-4413ad548760 req-1295ec1e-d8cf-4d8c-9940-9ae82c6c5671 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0624130 Jun 17 11:02:37.418773 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e101dcd3-9ddc-494b-9cd0-4413ad548760 req-c70963db-5be5-41ad-8df6-d001a340d266 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324671 Jun 17 11:02:37.590073 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb9981f8-1db1-4f41-bd9c-4102d7997395 req-53226daa-96c3-419e-a229-8245b2b8c7b6 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:37.591474 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb9981f8-1db1-4f41-bd9c-4102d7997395 req-53226daa-96c3-419e-a229-8245b2b8c7b6 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0637391 Jun 17 11:02:37.629065 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bb9981f8-1db1-4f41-bd9c-4102d7997395 req-0e7bb593-b15f-4952-8f3d-b04b76006ea3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312829 Jun 17 11:02:37.870677 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faaf2c2a-37d0-41c5-8950-c801ed8efc08 req-c78c18dc-3bdb-47ac-8dd8-4f970f663625 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:37.872141 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-faaf2c2a-37d0-41c5-8950-c801ed8efc08 req-c78c18dc-3bdb-47ac-8dd8-4f970f663625 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0642929 Jun 17 11:02:37.909741 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-faaf2c2a-37d0-41c5-8950-c801ed8efc08 req-beb037d5-232d-4ca4-b82b-39b6a6a0d66e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311384 Jun 17 11:02:38.593613 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e86dc1bc-7fac-4968-bda9-809e762d5684 req-a984c4fa-301a-48fc-b2bc-0884ab10eea0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:38.595644 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e86dc1bc-7fac-4968-bda9-809e762d5684 req-a984c4fa-301a-48fc-b2bc-0884ab10eea0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0612812 Jun 17 11:02:38.632615 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e86dc1bc-7fac-4968-bda9-809e762d5684 req-46b522cf-91ed-4553-830a-19b8d91d0e74 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314634 Jun 17 11:02:38.800947 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e4efbf-8d22-4173-94ce-29f3fe486143 req-67c077d1-362a-4308-9397-575f360b7d92 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:38.802381 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e1e4efbf-8d22-4173-94ce-29f3fe486143 req-67c077d1-362a-4308-9397-575f360b7d92 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0652926 Jun 17 11:02:38.839562 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e1e4efbf-8d22-4173-94ce-29f3fe486143 req-bba5aa2a-c651-4dcf-b3cc-c785c028e550 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316408 Jun 17 11:02:39.080002 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ad38ef-ca02-496c-a8d8-684cf3270eb1 req-66bc29db-ba74-47cf-83d3-ab45a84bf032 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:39.081367 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-84ad38ef-ca02-496c-a8d8-684cf3270eb1 req-66bc29db-ba74-47cf-83d3-ab45a84bf032 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0629144 Jun 17 11:02:39.119256 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-84ad38ef-ca02-496c-a8d8-684cf3270eb1 req-b50ed4a7-fad7-4cf8-83b1-e8d9d3448f96 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321937 Jun 17 11:02:39.404765 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5895b3-98cc-423b-bf96-5a2f6c79cff1 req-cfc78e93-f3c8-40a4-aae2-a6c8c4bddd51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:39.406748 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fe5895b3-98cc-423b-bf96-5a2f6c79cff1 req-cfc78e93-f3c8-40a4-aae2-a6c8c4bddd51 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=6c4c0226eef34f24a2c7072aba63129d&shared=False HTTP/1.1" status: 200 len: 908 time: 0.0922821 Jun 17 11:02:39.808011 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2810651d-26a0-4c3b-b2b6-9cc9937022ec req-7d4c9cb3-f5dd-4262-9956-1476c886052f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:39.809468 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2810651d-26a0-4c3b-b2b6-9cc9937022ec req-7d4c9cb3-f5dd-4262-9956-1476c886052f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0647385 Jun 17 11:02:39.848127 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2810651d-26a0-4c3b-b2b6-9cc9937022ec req-06fe97f5-c322-4a4f-bad0-122a2176f854 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331297 Jun 17 11:02:40.013865 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c22bcb3a-9966-41b4-a1e1-2d64cdd61d7b req-06648750-47fb-4178-896a-85734c6802e7 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:40.016025 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c22bcb3a-9966-41b4-a1e1-2d64cdd61d7b req-06648750-47fb-4178-896a-85734c6802e7 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0641510 Jun 17 11:02:40.054714 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c22bcb3a-9966-41b4-a1e1-2d64cdd61d7b req-1230673c-7e7c-4fcf-b624-6d85ab9d0332 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0331337 Jun 17 11:02:40.293130 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51bdce00-3cb4-4cc1-a1fc-072649893b5c req-44a7dbab-0e6a-423b-afe3-b60bc14a75bc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:40.294494 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-51bdce00-3cb4-4cc1-a1fc-072649893b5c req-44a7dbab-0e6a-423b-afe3-b60bc14a75bc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0663519 Jun 17 11:02:40.331709 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-51bdce00-3cb4-4cc1-a1fc-072649893b5c req-0957dfca-3662-4f26-816c-32879cb5162a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315962 Jun 17 11:02:41.024761 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3dc36d2-2c8f-46ba-aab9-508f22fd995b req-4c827a03-400a-4e41-9d62-e1f852a9ffd0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:41.026390 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e3dc36d2-2c8f-46ba-aab9-508f22fd995b req-4c827a03-400a-4e41-9d62-e1f852a9ffd0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0712073 Jun 17 11:02:41.063539 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e3dc36d2-2c8f-46ba-aab9-508f22fd995b req-ffc0e4c5-6e77-4087-8e64-390e28dedcf8 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309691 Jun 17 11:02:41.230127 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a658092c-18bd-444c-882e-8cf34f1deef2 req-da67f464-298c-4570-b603-f8322a760ee3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:41.231602 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a658092c-18bd-444c-882e-8cf34f1deef2 req-da67f464-298c-4570-b603-f8322a760ee3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0716381 Jun 17 11:02:41.271419 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a658092c-18bd-444c-882e-8cf34f1deef2 req-15c240a0-f2b3-45be-8dce-4451450ef664 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0334721 Jun 17 11:02:41.514654 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebdffc90-0af1-41c0-80da-11627ebe19a6 req-9929e2a8-4979-4166-8d4a-40a7c18978f5 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:41.516623 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ebdffc90-0af1-41c0-80da-11627ebe19a6 req-9929e2a8-4979-4166-8d4a-40a7c18978f5 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0671403 Jun 17 11:02:41.553124 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ebdffc90-0af1-41c0-80da-11627ebe19a6 req-0b3e2080-97ba-4c1a-acbd-4fb71b4ff1be tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308731 Jun 17 11:02:41.942770 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 7f393d5b-3d64-445d-8452-77f330f822c4 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:02:42.049962 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 7f393d5b-3d64-445d-8452-77f330f822c4 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:02:42.053909 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 7f393d5b-3d64-445d-8452-77f330f822c4 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:02:42.054309 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:42.066602 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9510beeb-3658-4ef6-ab7b-13c372fec346 req-c023c3c5-d6d5-4298-80db-dc82e030a3ab service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0555665 Jun 17 11:02:42.118557 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5895b3-98cc-423b-bf96-5a2f6c79cff1 req-85861bf6-5587-4e01-a718-6baf2d6aecf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:42.120183 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fe5895b3-98cc-423b-bf96-5a2f6c79cff1 req-85861bf6-5587-4e01-a718-6baf2d6aecf2 service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1099286 Jun 17 11:02:42.167690 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:42.186781 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9510beeb-3658-4ef6-ab7b-13c372fec346 req-f0996d90-b69e-4d93-8386-40834b982c13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:42.193300 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9510beeb-3658-4ef6-ab7b-13c372fec346 req-f0996d90-b69e-4d93-8386-40834b982c13 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 1098 time: 0.0776134 Jun 17 11:02:42.197341 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e92f4703-97e8-4a42-84dd-eaab237e23e3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f393d5b-3d64-445d-8452-77f330f822c4'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:02:42.199563 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b513b24c-8fb9-4bf7-b414-5c8801ca400e" -d '{"events": [{"server_uuid": "e92f4703-97e8-4a42-84dd-eaab237e23e3", "name": "network-vif-plugged", "status": "completed", "tag": "7f393d5b-3d64-445d-8452-77f330f822c4"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:02:42.216593 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 7f393d5b-3d64-445d-8452-77f330f822c4, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=7f393d5b-3d64-445d-8452-77f330f822c4,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:02:42.248424 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:02:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-212439b2-8e2b-4c53-a9d3-4375eb7a54c4 x-openstack-request-id: req-212439b2-8e2b-4c53-a9d3-4375eb7a54c4 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:02:42.248729 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e92f4703-97e8-4a42-84dd-eaab237e23e3", "name": "network-vif-plugged", "status": "completed", "tag": "7f393d5b-3d64-445d-8452-77f330f822c4", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:02:42.248985 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-212439b2-8e2b-4c53-a9d3-4375eb7a54c4 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:02:42.249484 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e92f4703-97e8-4a42-84dd-eaab237e23e3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f393d5b-3d64-445d-8452-77f330f822c4', 'code': 200} Jun 17 11:02:42.279749 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-548c8bde-3cb5-4d8d-ac7f-ca9fa815ae3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:42.281496 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-548c8bde-3cb5-4d8d-ac7f-ca9fa815ae3d service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=6c4c0226eef34f24a2c7072aba63129d&device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 1096 time: 0.1072915 Jun 17 11:02:42.300285 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fecc0b8-f380-4dcf-805f-c7a9c00703f2 req-cb52b9b5-bc10-469c-b9e3-f1b512e0748b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:42.301785 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1fecc0b8-f380-4dcf-805f-c7a9c00703f2 req-cb52b9b5-bc10-469c-b9e3-f1b512e0748b tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 945 time: 0.0967236 Jun 17 11:02:42.303361 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9510beeb-3658-4ef6-ab7b-13c372fec346 req-49a6be00-5556-417f-b6bb-1f205a80c1ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:42.304943 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9510beeb-3658-4ef6-ab7b-13c372fec346 req-49a6be00-5556-417f-b6bb-1f205a80c1ce service neutron] 10.222.0.25 "GET /v2.0/networks?id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 200 len: 915 time: 0.0932527 Jun 17 11:02:42.341432 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1fecc0b8-f380-4dcf-805f-c7a9c00703f2 req-6aaff0ed-5c48-41c8-9443-3c39a4419b56 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336440 Jun 17 11:02:42.363606 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:42.363606 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:42.421329 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-c44488d3-1459-4eb8-9397-0ce307b76561 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3084d465-862a-4dca-ba25-6a98d0b14fbb HTTP/1.1" status: 200 len: 217 time: 0.0425258 Jun 17 11:02:42.427007 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9510beeb-3658-4ef6-ab7b-13c372fec346 req-e43ac8ad-1ed5-4176-b24d-418b0d6a15fa service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d HTTP/1.1" status: 200 len: 217 time: 0.0461841 Jun 17 11:02:42.431454 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=7f393d5b-3d64-445d-8452-77f330f822c4,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:42.442333 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:42.472226 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-f6962551-d7b2-4ebb-abc8-34122d85f252 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:42.473587 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-f6962551-d7b2-4ebb-abc8-34122d85f252 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2567fd48-9bd6-4ffa-9d4c-72f989266554 HTTP/1.1" status: 200 len: 846 time: 0.0456016 Jun 17 11:02:42.504675 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9510beeb-3658-4ef6-ab7b-13c372fec346 req-559a9341-deb2-41bb-aea4-891d225f33e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:42.506256 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9510beeb-3658-4ef6-ab7b-13c372fec346 req-559a9341-deb2-41bb-aea4-891d225f33e7 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=c10bc074-5591-4fbf-953f-e4097d48cc79 HTTP/1.1" status: 200 len: 854 time: 0.0704834 Jun 17 11:02:42.537671 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-39eaa3a9-020f-4c25-a42a-3dc675d05af3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:42.539400 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-39eaa3a9-020f-4c25-a42a-3dc675d05af3 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=16bcab5c-7033-4cca-98e1-b173b2d78c2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0574877 Jun 17 11:02:42.546531 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9510beeb-3658-4ef6-ab7b-13c372fec346 req-4c486149-a050-4798-b15f-c36e86571ed3 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0333092 Jun 17 11:02:42.555109 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793d51a2-bdf2-4407-8028-cfc7f13764db req-cbe9e272-ccd6-4346-8d3e-0e0596cc34c0 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:42.556765 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-793d51a2-bdf2-4407-8028-cfc7f13764db req-cbe9e272-ccd6-4346-8d3e-0e0596cc34c0 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.1322546 Jun 17 11:02:42.653786 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-793d51a2-bdf2-4407-8028-cfc7f13764db req-5d424678-32d3-4e9e-9d13-c7fba9ee2872 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0876017 Jun 17 11:02:42.679045 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-f7cbc857-a880-4114-b088-ff028b9f3595 service neutron] 10.222.0.25 "GET /v2.0/networks/16bcab5c-7033-4cca-98e1-b173b2d78c2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1221070 Jun 17 11:02:42.683118 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9510beeb-3658-4ef6-ab7b-13c372fec346 req-d7e98b5b-fb9f-4f3f-aee1-225f0ede0ab8 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1252072 Jun 17 11:02:42.787912 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9510beeb-3658-4ef6-ab7b-13c372fec346 req-bc8e3eaf-d2a4-4512-8108-a44613b215c4 service neutron] 10.222.0.25 "GET /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0924239 Jun 17 11:02:42.869828 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8b274a88-8ec5-4ed3-9874-3652bc5d4b42 req-bb1462f7-6a83-4594-a2c4-189b6464a165 service neutron] 10.222.0.25 "GET /v2.0/networks/16bcab5c-7033-4cca-98e1-b173b2d78c2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1703155 Jun 17 11:02:42.873514 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f791f46-21e6-4cff-9219-1063f2495db8 req-596cf798-3d6a-4cea-bd11-f9bb41f33db1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:42.874579 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4f791f46-21e6-4cff-9219-1063f2495db8 req-596cf798-3d6a-4cea-bd11-f9bb41f33db1 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 1099 time: 0.1437111 Jun 17 11:02:42.882780 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717fc133-3445-434e-9570-111b7ab7eb5e req-4dfafef7-5b2d-4113-b073-0b06a454a9c2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:42.884255 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-717fc133-3445-434e-9570-111b7ab7eb5e req-4dfafef7-5b2d-4113-b073-0b06a454a9c2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.2005889 Jun 17 11:02:42.933703 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4f791f46-21e6-4cff-9219-1063f2495db8 req-24c58263-a85b-463e-a29c-4a30c8954890 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484877 Jun 17 11:02:42.941578 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-717fc133-3445-434e-9570-111b7ab7eb5e req-bd4ccc1a-cb16-4429-b0ad-ad37d57b1861 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500522 Jun 17 11:02:43.517319 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c2d5538-1f0a-411b-8556-9ab7e4aaac74 req-9e714a3e-0101-4a9d-951b-72e2e564c7e8 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:43.518782 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8c2d5538-1f0a-411b-8556-9ab7e4aaac74 req-9e714a3e-0101-4a9d-951b-72e2e564c7e8 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 946 time: 0.0653813 Jun 17 11:02:43.555414 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8c2d5538-1f0a-411b-8556-9ab7e4aaac74 req-6b6a734f-dc6d-42b0-975c-68d0d6ac3546 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308683 Jun 17 11:02:43.843252 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b667f164-18ef-4b21-9d80-6d3ba97548c5 req-9bc4ee3e-70e5-47e8-92d1-72093b3a3bb1 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:43.845310 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b667f164-18ef-4b21-9d80-6d3ba97548c5 req-9bc4ee3e-70e5-47e8-92d1-72093b3a3bb1 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0623417 Jun 17 11:02:43.881759 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b667f164-18ef-4b21-9d80-6d3ba97548c5 req-f1b176b1-c865-4188-8c24-edfa710a2582 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309064 Jun 17 11:02:44.119340 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b04a31-16a4-4b30-8cab-30263aa8726b req-11e20263-81a4-4624-aa15-4dd29f34a9ad tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:44.120760 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-31b04a31-16a4-4b30-8cab-30263aa8726b req-11e20263-81a4-4624-aa15-4dd29f34a9ad tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0649211 Jun 17 11:02:44.159805 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-31b04a31-16a4-4b30-8cab-30263aa8726b req-e492d645-d082-4aca-9346-740362db4fdc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316317 Jun 17 11:02:44.745824 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b701c187-b196-4bd0-b83f-bc8ad44ccdb2 req-e8a38c3a-c954-4856-882e-3e39074e27ad tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:44.747779 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b701c187-b196-4bd0-b83f-bc8ad44ccdb2 req-e8a38c3a-c954-4856-882e-3e39074e27ad tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 946 time: 0.0755267 Jun 17 11:02:44.799566 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b701c187-b196-4bd0-b83f-bc8ad44ccdb2 req-f9186790-3591-43f8-96f9-b2cfc272d405 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389061 Jun 17 11:02:45.081024 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3aa5fd-7a84-4398-acc6-b111778745f5 req-820db838-734d-4886-a286-e1934b6b77a3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:45.088354 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bd3aa5fd-7a84-4398-acc6-b111778745f5 req-820db838-734d-4886-a286-e1934b6b77a3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0892210 Jun 17 11:02:45.144101 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bd3aa5fd-7a84-4398-acc6-b111778745f5 req-775266e0-ece5-4dc8-9945-642ec87ddb60 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459309 Jun 17 11:02:45.442243 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fa0dbea-3522-41d7-ad16-3f0c2c8f2407 req-7df271f4-c793-490f-ac3c-87d2406b3255 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:45.444196 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3fa0dbea-3522-41d7-ad16-3f0c2c8f2407 req-7df271f4-c793-490f-ac3c-87d2406b3255 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0972116 Jun 17 11:02:45.510652 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3fa0dbea-3522-41d7-ad16-3f0c2c8f2407 req-1aeaf6f6-3fb3-4d9c-bdb7-a9e466a30d28 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595486 Jun 17 11:02:45.580537 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 36480) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:45.692679 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9f3db57c-5925-4da0-a592-bd58cc2dd7a1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:45.785578 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9f3db57c-5925-4da0-a592-bd58cc2dd7a1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:45.895550 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9f3db57c-5925-4da0-a592-bd58cc2dd7a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:45.899071 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bf375614-26aa-4241-a549-45f70c439fb9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:45.932988 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-9f3db57c-5925-4da0-a592-bd58cc2dd7a1 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=479213c1175e449386c7df6ce585df2f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3513858 Jun 17 11:02:45.935254 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f3db57c-5925-4da0-a592-bd58cc2dd7a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77771d25-fc11-4d88-ba36-336e7cfa5bcf,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:45.938187 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 36486) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:45.941886 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9f3db57c-5925-4da0-a592-bd58cc2dd7a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:45.990142 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-dfad1eb8-6122-4391-8d42-3fdfe0345741 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:45.990759 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18054f5-a4a8-4b55-8bb4-588b8733eb43 req-c0159744-5a8c-4d23-9198-c078f734c029 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:45.992424 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a18054f5-a4a8-4b55-8bb4-588b8733eb43 req-c0159744-5a8c-4d23-9198-c078f734c029 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 946 time: 0.0719955 Jun 17 11:02:46.011733 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-dfad1eb8-6122-4391-8d42-3fdfe0345741 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:46.041419 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a18054f5-a4a8-4b55-8bb4-588b8733eb43 req-03a136bd-fde1-419e-81f8-9d5eee1f752d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427825 Jun 17 11:02:46.158807 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-dfad1eb8-6122-4391-8d42-3fdfe0345741 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:46.161361 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-dfad1eb8-6122-4391-8d42-3fdfe0345741 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:46.162477 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-dfad1eb8-6122-4391-8d42-3fdfe0345741 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/77771d25-fc11-4d88-ba36-336e7cfa5bcf HTTP/1.1" status: 204 len: 168 time: 0.2233899 Jun 17 11:02:46.163238 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c030e30b-c300-485e-beb6-b3ff220f526e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:46.170591 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfad1eb8-6122-4391-8d42-3fdfe0345741 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77771d25-fc11-4d88-ba36-336e7cfa5bcf,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:46.173770 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-dfad1eb8-6122-4391-8d42-3fdfe0345741 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:46.345316 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdcf5098-3859-4f9b-b282-a53f6c6dbc27 req-3556b13f-71ce-4f92-b976-f1377ee142b4 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:46.346806 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fdcf5098-3859-4f9b-b282-a53f6c6dbc27 req-3556b13f-71ce-4f92-b976-f1377ee142b4 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0678658 Jun 17 11:02:46.388547 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fdcf5098-3859-4f9b-b282-a53f6c6dbc27 req-dcad9b36-9024-4033-b528-1a0f0ff42a33 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0356166 Jun 17 11:02:46.694988 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64fa8c2d-d72d-47fe-b32a-44d29ed728ca req-c75802b6-b4c3-44a6-938f-eb9f9a336a58 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:46.696523 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-64fa8c2d-d72d-47fe-b32a-44d29ed728ca req-c75802b6-b4c3-44a6-938f-eb9f9a336a58 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0636804 Jun 17 11:02:46.737745 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-64fa8c2d-d72d-47fe-b32a-44d29ed728ca req-5279751a-e7d2-4329-b8c9-b16d075710a3 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349455 Jun 17 11:02:47.232431 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea5593e-2de2-40ee-b4d0-2a6894f8bd93 req-49c2c9c8-765c-4de7-a7d9-d296cb31b78d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:47.234340 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 36530) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:47.239436 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-eea5593e-2de2-40ee-b4d0-2a6894f8bd93 req-49c2c9c8-765c-4de7-a7d9-d296cb31b78d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 946 time: 0.0717397 Jun 17 11:02:47.273879 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-eea5593e-2de2-40ee-b4d0-2a6894f8bd93 req-8966400f-ee00-4a32-b1bd-f3aba51503f6 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335953 Jun 17 11:02:47.335913 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-2070988767-network', 'tenant_id': '639911d94d744c97a47444f2f5785c40'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:02:47.428037 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Made reservation on behalf of 639911d94d744c97a47444f2f5785c40 for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:02:47.430383 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:47.439244 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:47.559033 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:47.594921 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c30b71f9-cdd9-445f-bf1c-1d019bcf8765 req-c72f8d77-58c6-49af-ac4b-eb11f49e233f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:47.596403 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c30b71f9-cdd9-445f-bf1c-1d019bcf8765 req-c72f8d77-58c6-49af-ac4b-eb11f49e233f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0883334 Jun 17 11:02:47.638077 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c30b71f9-cdd9-445f-bf1c-1d019bcf8765 req-37854618-cc26-4e85-bd69-f78815f1708c tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359726 Jun 17 11:02:47.718426 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:47.721579 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-840d2f5e-1f92-447f-93d0-f60968c4f1ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:47.743138 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=110215) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 11:02:47.753291 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fee73bc9-1acf-45ca-8281-284d22c0b22f,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:47.756989 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:47.759794 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:47.760140 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Added segment b30833e2-269b-473f-8667-473b40248da0 of type vlan for network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 Jun 17 11:02:47.803676 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:47.913687 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:47.918430 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:47.919030 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:47.925497 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-93253a1b-8ad4-40ef-8d2d-fe8dcd840391 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:47.951209 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abfe4b75-6e31-4547-a4dd-1a80ceae13c7 req-97dbcda5-0f57-44f4-8a11-3eb13ecd93af tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:47.952648 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-abfe4b75-6e31-4547-a4dd-1a80ceae13c7 req-97dbcda5-0f57-44f4-8a11-3eb13ecd93af tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0925820 Jun 17 11:02:48.015900 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Pushing event updated for resources: {'Network': ['ID=ac073896-1dc1-4a1c-bbb5-f73d05a0f328,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:48.020975 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:48.029175 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 11:02:48.040975 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-abfe4b75-6e31-4547-a4dd-1a80ceae13c7 req-a0bd95a0-abbe-4303-b546-f862d0104105 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0781004 Jun 17 11:02:48.063054 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.8275366 Jun 17 11:02:48.075002 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 36552) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:48.080278 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Request body: {'subnet': {'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-2070988767-subnet', 'tenant_id': '639911d94d744c97a47444f2f5785c40', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:02:48.233074 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Made reservation on behalf of 639911d94d744c97a47444f2f5785c40 for: {'subnet': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:02:48.236135 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5636039'] for subnet, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:48.473189 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5898957', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5636053'] for subnet, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:48.476260 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-056fa40d-1af6-4631-9825-d86e0af22318 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:48.528908 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4f767ce8-3cfb-498b-9928-86e92efe06d9,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:48.533791 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:48.537643 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Checking segment: {'id': 'b30833e2-269b-473f-8667-473b40248da0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:02:48.537993 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Network hostable DHCP agents. Network: ac073896-1dc1-4a1c-bbb5-f73d05a0f328, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110215) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 11:02:48.650390 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110215) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 11:02:48.759217 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, ac073896-1dc1-4a1c-bbb5-f73d05a0f328) {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:02:48.769948 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:48.770538 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:48.772461 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1aa9aa74-992a-4b9b-b59b-117c91d7fc1a None None] Network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:02:48.840152 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e073b8b-70d2-4e34-8f44-fde1ea6bbaa0 req-792c35fa-cce5-46ca-9ef6-25e4facd56ee tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:48.841800 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4e073b8b-70d2-4e34-8f44-fde1ea6bbaa0 req-792c35fa-cce5-46ca-9ef6-25e4facd56ee tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0784457 Jun 17 11:02:48.868183 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-bd56e14a-dc71-48e1-9965-7b88a066eb32 admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.7919855 Jun 17 11:02:48.886630 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4e073b8b-70d2-4e34-8f44-fde1ea6bbaa0 req-ef8726d6-2bdf-4026-888c-d64c727331c5 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0365980 Jun 17 11:02:49.043666 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b95e3a8-7faf-4259-9cce-03ccce5c8089 None None] Network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:02:49.255580 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb4eff6-dc59-4c90-9f6b-51cb8aec0a29 req-3d7f0ec2-e482-4d14-a89c-97bbef0e017e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:49.262013 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fbb4eff6-dc59-4c90-9f6b-51cb8aec0a29 req-3d7f0ec2-e482-4d14-a89c-97bbef0e017e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0722704 Jun 17 11:02:49.311567 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fbb4eff6-dc59-4c90-9f6b-51cb8aec0a29 req-4cf597d7-1815-4926-a503-2f4ac3794dc8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482593 Jun 17 11:02:49.855719 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55e49a4a-c11c-46f3-8479-23f15ac88144 req-1cf8b3fc-5bca-4b7d-9753-6e9f934bdbb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:49.857442 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-55e49a4a-c11c-46f3-8479-23f15ac88144 req-1cf8b3fc-5bca-4b7d-9753-6e9f934bdbb8 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 1098 time: 0.0665245 Jun 17 11:02:49.894930 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-55e49a4a-c11c-46f3-8479-23f15ac88144 req-543d3b5f-4949-4fd4-af72-4c5ae32a25dc service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0300195 Jun 17 11:02:50.078465 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a6a09dd-5a47-4fad-bea6-ab58b69c9164 req-54229608-3822-42a9-9c23-5792a334f2a4 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:50.080017 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3a6a09dd-5a47-4fad-bea6-ab58b69c9164 req-54229608-3822-42a9-9c23-5792a334f2a4 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0743761 Jun 17 11:02:50.121054 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3a6a09dd-5a47-4fad-bea6-ab58b69c9164 req-99ae6d99-b620-4963-b367-63ba0703910e tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0347197 Jun 17 11:02:50.492451 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60eb2f2d-01d3-4ed4-9b01-48adcf74ef81 req-6e86aa59-b934-4f40-85fc-420c7f0644e2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:50.493906 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-60eb2f2d-01d3-4ed4-9b01-48adcf74ef81 req-6e86aa59-b934-4f40-85fc-420c7f0644e2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0627508 Jun 17 11:02:50.551562 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-60eb2f2d-01d3-4ed4-9b01-48adcf74ef81 req-c35c2d91-f816-48d2-b5bc-ea52e575782a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516682 Jun 17 11:02:50.621714 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-52f95c1b-9098-4226-a5ad-60cd41c4b96c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:50.773256 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 36614) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:50.879307 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ab1d4a7f-ad6f-4183-af91-dce1ee539379 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:50.969336 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ab1d4a7f-ad6f-4183-af91-dce1ee539379 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:51.027761 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ab1d4a7f-ad6f-4183-af91-dce1ee539379 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:51.031863 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:51.069411 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-ab1d4a7f-ad6f-4183-af91-dce1ee539379 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=702b18e9fc55429da640094ae100a5c5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2950845 Jun 17 11:02:51.070591 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab1d4a7f-ad6f-4183-af91-dce1ee539379 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44074bd1-5449-4e08-8e91-c14da57f1982,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:51.073945 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 36622) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:02:51.074451 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ab1d4a7f-ad6f-4183-af91-dce1ee539379 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:51.135121 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-873abb89-6167-4d83-ad9f-59c83169ce0e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:51.162449 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-873abb89-6167-4d83-ad9f-59c83169ce0e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:51.307133 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-873abb89-6167-4d83-ad9f-59c83169ce0e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:51.309770 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-873abb89-6167-4d83-ad9f-59c83169ce0e admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:51.310994 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-873abb89-6167-4d83-ad9f-59c83169ce0e admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/44074bd1-5449-4e08-8e91-c14da57f1982 HTTP/1.1" status: 204 len: 168 time: 0.2358792 Jun 17 11:02:51.313164 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e7128c35-12df-47ab-9a4f-a462953730a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:51.325234 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-873abb89-6167-4d83-ad9f-59c83169ce0e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44074bd1-5449-4e08-8e91-c14da57f1982,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:51.330774 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-873abb89-6167-4d83-ad9f-59c83169ce0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:51.344209 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282db2fd-da52-49d8-ab8b-61c77ab4555d req-df4c7b65-44f6-433f-ba93-0f9a5d65dbbc tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:51.346192 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-282db2fd-da52-49d8-ab8b-61c77ab4555d req-df4c7b65-44f6-433f-ba93-0f9a5d65dbbc tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0855746 Jun 17 11:02:51.392158 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-282db2fd-da52-49d8-ab8b-61c77ab4555d req-b7b02c61-d25d-49e6-bf4d-9711b34a82ab tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0366056 Jun 17 11:02:51.745706 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163ce329-098d-4a03-8921-23144de15b93 req-5ddb4680-58ad-498b-abf1-00f79a539f7e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:51.747243 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-163ce329-098d-4a03-8921-23144de15b93 req-5ddb4680-58ad-498b-abf1-00f79a539f7e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0728519 Jun 17 11:02:51.790231 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-163ce329-098d-4a03-8921-23144de15b93 req-c9814987-41fb-4cbb-b77c-1178d827e0a6 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360086 Jun 17 11:02:51.962785 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de64660d-7dcf-442b-a832-a1fb4fd58fcf req-d3310fcf-eaa7-41b9-b5cd-76c99a8af021 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:51.964353 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-de64660d-7dcf-442b-a832-a1fb4fd58fcf req-d3310fcf-eaa7-41b9-b5cd-76c99a8af021 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0635715 Jun 17 11:02:52.004567 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-de64660d-7dcf-442b-a832-a1fb4fd58fcf req-73646615-fe6d-4168-9f64-ec0734b1a399 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0345526 Jun 17 11:02:52.051158 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:02:52.582876 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9999161-7b81-403a-be1c-4547a3470f96 req-67a09435-7f4d-48b7-a13a-f92f3fd1139e tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:52.584387 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d9999161-7b81-403a-be1c-4547a3470f96 req-67a09435-7f4d-48b7-a13a-f92f3fd1139e tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0634804 Jun 17 11:02:52.624382 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-92112cfe-87b7-4e39-b433-2eaa35c6e82c tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:52.625516 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d9999161-7b81-403a-be1c-4547a3470f96 req-6dd351ce-f48f-4049-9d86-e1d4127a01b9 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0332248 Jun 17 11:02:52.625857 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-92112cfe-87b7-4e39-b433-2eaa35c6e82c tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/networks?id=ac073896-1dc1-4a1c-bbb5-f73d05a0f328 HTTP/1.1" status: 200 len: 814 time: 0.1057210 Jun 17 11:02:52.641676 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-85ac6f8f-57a3-4f09-8d9f-c34245623468 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/quotas/639911d94d744c97a47444f2f5785c40 HTTP/1.1" status: 200 len: 375 time: 0.0093422 Jun 17 11:02:52.682321 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-1c738f83-9684-4a0a-b5f0-cb8582af1726 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=639911d94d744c97a47444f2f5785c40&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0347121 Jun 17 11:02:52.775977 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-a917f0cd-b15e-416e-ab17-89fa250bd714 service neutron] 10.222.0.41 "GET /v2.0/networks/ac073896-1dc1-4a1c-bbb5-f73d05a0f328?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867391 Jun 17 11:02:52.868243 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-e65c6366-6a12-47a9-bd2c-6bea053ab8f1 service neutron] 10.222.0.41 "GET /v2.0/networks/ac073896-1dc1-4a1c-bbb5-f73d05a0f328?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847321 Jun 17 11:02:53.117361 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-86197aaf-7e45-4671-9e24-0ee85fb0d806 req-6c987666-9801-4008-8d03-e45a3b3e4ef0 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 210 time: 0.0281014 Jun 17 11:02:53.358715 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6d577508-ba67-4bfc-989c-4ce7b73c2748 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:53.598493 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:53.808699 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c816e2b-ea73-4e1c-9f2c-eda23f82b26f req-267d1b62-c058-4b14-9d00-b90448701b8a tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:53.815927 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6c816e2b-ea73-4e1c-9f2c-eda23f82b26f req-267d1b62-c058-4b14-9d00-b90448701b8a tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 943 time: 0.0673943 Jun 17 11:02:53.847577 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6c816e2b-ea73-4e1c-9f2c-eda23f82b26f req-23758082-e9cd-42b8-9d32-8602b8624848 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306332 Jun 17 11:02:53.920982 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 3084d465-862a-4dca-ba25-6a98d0b14fbb details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:02:54.017110 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 3084d465-862a-4dca-ba25-6a98d0b14fbb, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=3084d465-862a-4dca-ba25-6a98d0b14fbb,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:02:54.028023 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '3084d465-862a-4dca-ba25-6a98d0b14fbb', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'port_id': '3084d465-862a-4dca-ba25-6a98d0b14fbb', 'mac_address': 'fa:16:3e:fe:01:dc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:02:54.064079 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:54.077103 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3084d465-862a-4dca-ba25-6a98d0b14fbb {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:02:54.097213 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 3084d465-862a-4dca-ba25-6a98d0b14fbb, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=3084d465-862a-4dca-ba25-6a98d0b14fbb,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:02:54.187301 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:54.189576 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2a779021-0275-4c0a-81a6-da578148b5b3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:54.197862 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6cb4381d-5065-4d98-8522-74eb22868509 req-05f28d5a-012e-494a-8e09-ba2ea2b3c025 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 210 time: 0.0292592 Jun 17 11:02:54.235993 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=3084d465-862a-4dca-ba25-6a98d0b14fbb,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:54.239855 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:54.479107 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:54.678941 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['3084d465-862a-4dca-ba25-6a98d0b14fbb'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:02:55.029511 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8ad3a3-88fb-4012-aec3-090c266d3f64 req-1bb4b7c5-338c-477e-92a6-3ff5bc8e7ad3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:55.030988 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8b8ad3a3-88fb-4012-aec3-090c266d3f64 req-1bb4b7c5-338c-477e-92a6-3ff5bc8e7ad3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 944 time: 0.0639899 Jun 17 11:02:55.069332 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8b8ad3a3-88fb-4012-aec3-090c266d3f64 req-8fa0c8c0-9c0d-45b4-af05-adbceb43d49c tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321035 Jun 17 11:02:55.338220 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1adf1f40-90b8-4b86-979d-5962a902f257 req-2eecbff7-5a5f-4948-857c-5b0a356164f8 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 210 time: 0.0284107 Jun 17 11:02:55.461464 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb6b9d5-32d0-4584-825a-d7c2e26d13ea req-cb330fbb-1751-448d-a7bb-99a360059cbd tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:55.462930 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-acb6b9d5-32d0-4584-825a-d7c2e26d13ea req-cb330fbb-1751-448d-a7bb-99a360059cbd tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0973787 Jun 17 11:02:55.493476 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f5ff73-80a3-4233-b2d5-3accfaf4bd12 req-4e35bdb3-d1a1-4233-b7cf-3ffb50892416 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:55.494948 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1f5ff73-80a3-4233-b2d5-3accfaf4bd12 req-4e35bdb3-d1a1-4233-b7cf-3ffb50892416 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 1098 time: 0.0906518 Jun 17 11:02:55.547334 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-acb6b9d5-32d0-4584-825a-d7c2e26d13ea req-ef0b0c9d-379d-4803-a6ac-8c1e73d50681 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780253 Jun 17 11:02:55.670529 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f5ff73-80a3-4233-b2d5-3accfaf4bd12 req-3c61e19f-28f9-4443-af5d-cbb4ee2f4229 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:55.671992 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1f5ff73-80a3-4233-b2d5-3accfaf4bd12 req-3c61e19f-28f9-4443-af5d-cbb4ee2f4229 service neutron] 10.222.0.25 "GET /v2.0/networks?id=0fe823e2-06dd-4212-84a6-8e0beda57580 HTTP/1.1" status: 200 len: 920 time: 0.1670442 Jun 17 11:02:55.680076 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-8138ba4b-9dad-4ea8-bee0-7e223dc00e4a tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:55.681677 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-8138ba4b-9dad-4ea8-bee0-7e223dc00e4a tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.25 "GET /v2.0/networks?id=ac073896-1dc1-4a1c-bbb5-f73d05a0f328 HTTP/1.1" status: 200 len: 814 time: 0.1756961 Jun 17 11:02:55.724228 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Request body: {'port': {'device_id': 'ad131e18-76ae-4d60-8e93-58748c554d77', 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328', 'admin_state_up': True, 'tenant_id': '639911d94d744c97a47444f2f5785c40'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:02:55.727976 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1f5ff73-80a3-4233-b2d5-3accfaf4bd12 req-b5b34db5-d5d3-43bc-8ca7-744f7188e70d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2ec3e896-70d1-4c47-933b-7234e4f744ed HTTP/1.1" status: 200 len: 217 time: 0.0454078 Jun 17 11:02:56.059283 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f5ff73-80a3-4233-b2d5-3accfaf4bd12 req-ee696925-48e3-4d94-aee8-f260446a8d74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:56.060720 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1f5ff73-80a3-4233-b2d5-3accfaf4bd12 req-ee696925-48e3-4d94-aee8-f260446a8d74 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=ab7c7a9f-b422-4b40-b94a-6939be91bbb8 HTTP/1.1" status: 200 len: 859 time: 0.0923543 Jun 17 11:02:56.100428 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1f5ff73-80a3-4233-b2d5-3accfaf4bd12 req-f7106695-b877-4371-a68f-3e48c9c6358d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0fe823e2-06dd-4212-84a6-8e0beda57580&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0316393 Jun 17 11:02:56.227596 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1f5ff73-80a3-4233-b2d5-3accfaf4bd12 req-ef748f3b-da1f-40e3-930c-6ab664a7f40e service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1170955 Jun 17 11:02:56.233730 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Made reservation on behalf of 639911d94d744c97a47444f2f5785c40 for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:02:56.237691 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:56.372214 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44bc9fde-54fa-4152-acab-e537f050e61e req-b0686f57-3c0e-4044-a18f-1c3afae44956 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:56.373703 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44bc9fde-54fa-4152-acab-e537f050e61e req-b0686f57-3c0e-4044-a18f-1c3afae44956 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 944 time: 0.1922009 Jun 17 11:02:56.457338 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1f5ff73-80a3-4233-b2d5-3accfaf4bd12 req-ec482d1b-e179-43c7-81d1-80995ca98e11 service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2166078 Jun 17 11:02:56.468424 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44bc9fde-54fa-4152-acab-e537f050e61e req-516c028b-8d53-4ff3-aba7-5b5722940c3d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0840693 Jun 17 11:02:56.483318 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Allocated IP 172.20.0.12 (ac073896-1dc1-4a1c-bbb5-f73d05a0f328/4f767ce8-3cfb-498b-9928-86e92efe06d9/316b36b2-c75c-42ff-9b5d-368f0037bc5d) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:02:56.489898 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d410c403-db6f-466a-bfe0-6101b5119363 req-244e9e59-0f1f-4cbb-b5aa-3ac575d2961e tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 210 time: 0.0353858 Jun 17 11:02:56.643390 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:56.739668 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-946ed7e9-cda2-44a4-b592-323874f8a89a req-eca4b448-5a62-4cb4-a6a3-0989b5d9fc27 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:56.741206 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-946ed7e9-cda2-44a4-b592-323874f8a89a req-eca4b448-5a62-4cb4-a6a3-0989b5d9fc27 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0717301 Jun 17 11:02:56.774552 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:56.779560 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-24fa672d-7a68-4834-9e1e-be2dcd303b3c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:56.786631 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-946ed7e9-cda2-44a4-b592-323874f8a89a req-355be3a5-b7e0-401d-ba2e-de82aba6f109 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398462 Jun 17 11:02:56.798988 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:56.821786 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:02:56.824936 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:02:56.828797 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:02:56.862450 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Pushing event updated for resources: {'Port': ['ID=316b36b2-c75c-42ff-9b5d-368f0037bc5d,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:56.875273 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.875642 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.876000 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.876354 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.876701 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.877310 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.877682 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.878024 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.878369 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.878704 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.879070 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.879405 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:56.884365 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:56.897035 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:56.897629 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:56.970917 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2507555 Jun 17 11:02:56.985115 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Request body: {'port': {'device_id': 'ad131e18-76ae-4d60-8e93-58748c554d77', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:02:57.055847 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:57.322455 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 316b36b2-c75c-42ff-9b5d-368f0037bc5d {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:02:57.329629 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:57.341172 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Transition to ACTIVE for port object 316b36b2-c75c-42ff-9b5d-368f0037bc5d will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:02:57.399042 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:57.401007 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:57.476872 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Pushing event updated for resources: {'Port': ['ID=316b36b2-c75c-42ff-9b5d-368f0037bc5d,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:57.480495 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:57.550168 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Attempting to bind port 316b36b2-c75c-42ff-9b5d-368f0037bc5d on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:02:57.550505 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Attempting to bind port 316b36b2-c75c-42ff-9b5d-368f0037bc5d by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': 'b30833e2-269b-473f-8667-473b40248da0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:02:57.550836 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Attempting to bind port 316b36b2-c75c-42ff-9b5d-368f0037bc5d on network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:02:57.555600 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Port 316b36b2-c75c-42ff-9b5d-368f0037bc5d on network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:02:57.555927 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Attempting to bind port 316b36b2-c75c-42ff-9b5d-368f0037bc5d on network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:02:57.561192 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 2, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:02:57.561504 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Checking segment: {'id': 'b30833e2-269b-473f-8667-473b40248da0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:02:57.561888 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Bound using segment: {'id': 'b30833e2-269b-473f-8667-473b40248da0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:02:57.562321 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Bound port: 316b36b2-c75c-42ff-9b5d-368f0037bc5d, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b30833e2-269b-473f-8667-473b40248da0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:02:57.562675 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:57.668372 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] For port 316b36b2-c75c-42ff-9b5d-368f0037bc5d, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:02:57.672451 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] For port 316b36b2-c75c-42ff-9b5d-368f0037bc5d, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=316b36b2-c75c-42ff-9b5d-368f0037bc5d,segment=NetworkSegment(b30833e2-269b-473f-8667-473b40248da0),segment_id=b30833e2-269b-473f-8667-473b40248da0)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:02:57.685716 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f2df766-1767-4b46-a73c-792f0171a405 req-870b9b1e-65dd-4340-a8d9-cc67e70273b2 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:57.685716 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8f2df766-1767-4b46-a73c-792f0171a405 req-870b9b1e-65dd-4340-a8d9-cc67e70273b2 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 944 time: 0.0693674 Jun 17 11:02:57.715147 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad4d184f-23b0-4aa4-ad12-072bea01146d req-a3d4ec61-6416-4267-92e9-8d21c7e9ef78 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:57.722299 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ad4d184f-23b0-4aa4-ad12-072bea01146d req-a3d4ec61-6416-4267-92e9-8d21c7e9ef78 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 944 time: 0.1262772 Jun 17 11:02:57.742324 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8f2df766-1767-4b46-a73c-792f0171a405 req-42502f07-823d-40dd-8d7a-35342c663e5b tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448155 Jun 17 11:02:57.749606 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:57.757608 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-94f3cd46-1412-4537-a850-8a9dd2ae581d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:57.794323 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ad4d184f-23b0-4aa4-ad12-072bea01146d req-5ae9f15e-d60e-4f55-b684-db452f4d60a3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0711632 Jun 17 11:02:57.804008 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:57.804615 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:57.805961 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] 10.222.0.25 "PUT /v2.0/ports/316b36b2-c75c-42ff-9b5d-368f0037bc5d HTTP/1.1" status: 200 len: 1094 time: 0.8249545 Jun 17 11:02:57.806454 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ad131e18-76ae-4d60-8e93-58748c554d77', 'tag': '316b36b2-c75c-42ff-9b5d-368f0037bc5d'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:02:57.808765 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bebd4c36-261e-45f3-aedc-f6ff8059a351" -d '{"events": [{"name": "network-changed", "server_uuid": "ad131e18-76ae-4d60-8e93-58748c554d77", "tag": "316b36b2-c75c-42ff-9b5d-368f0037bc5d"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:02:57.838789 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Pushing event updated for resources: {'Port': ['ID=316b36b2-c75c-42ff-9b5d-368f0037bc5d,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:57.842196 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:57.852820 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:02:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6cecd12-6871-4d5d-8cdc-db868636c8e6 x-openstack-request-id: req-e6cecd12-6871-4d5d-8cdc-db868636c8e6 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:02:57.853142 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ad131e18-76ae-4d60-8e93-58748c554d77", "tag": "316b36b2-c75c-42ff-9b5d-368f0037bc5d", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:02:57.853447 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-e6cecd12-6871-4d5d-8cdc-db868636c8e6 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:02:57.853874 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ad131e18-76ae-4d60-8e93-58748c554d77', 'tag': '316b36b2-c75c-42ff-9b5d-368f0037bc5d', 'status': 'completed', 'code': 200} Jun 17 11:02:57.954656 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bebd4c36-261e-45f3-aedc-f6ff8059a351 req-66ed989e-907d-441c-8447-734e6a8428ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:57.956123 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bebd4c36-261e-45f3-aedc-f6ff8059a351 req-66ed989e-907d-441c-8447-734e6a8428ca service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=639911d94d744c97a47444f2f5785c40&device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 1097 time: 0.0587759 Jun 17 11:02:57.967861 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 3084d465-862a-4dca-ba25-6a98d0b14fbb up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:02:57.971951 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77078fa5-fe4d-4661-b138-b615c48bb14d req-b7ca8269-0a65-4356-bd3e-d7e11d6a60c6 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:57.973624 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-77078fa5-fe4d-4661-b138-b615c48bb14d req-b7ca8269-0a65-4356-bd3e-d7e11d6a60c6 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0682919 Jun 17 11:02:58.020297 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-77078fa5-fe4d-4661-b138-b615c48bb14d req-feedd7f2-c0eb-44f8-8acf-f02c2d55dd0a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396600 Jun 17 11:02:58.065160 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bebd4c36-261e-45f3-aedc-f6ff8059a351 req-a7ee520c-2b9d-4be0-a6df-b786ed0025db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:58.066629 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bebd4c36-261e-45f3-aedc-f6ff8059a351 req-a7ee520c-2b9d-4be0-a6df-b786ed0025db service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=639911d94d744c97a47444f2f5785c40&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1024308 Jun 17 11:02:58.097149 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 3084d465-862a-4dca-ba25-6a98d0b14fbb completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:02:58.101182 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 3084d465-862a-4dca-ba25-6a98d0b14fbb triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:02:58.101563 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:58.168580 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bebd4c36-261e-45f3-aedc-f6ff8059a351 req-9633b0ae-5e57-4562-aaf5-86c5e13fdade service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:58.170087 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bebd4c36-261e-45f3-aedc-f6ff8059a351 req-9633b0ae-5e57-4562-aaf5-86c5e13fdade service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0957022 Jun 17 11:02:58.185857 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:58.211579 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3084d465-862a-4dca-ba25-6a98d0b14fbb'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:02:58.214202 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-746e4352-b265-481e-bb01-c800154e5626" -d '{"events": [{"server_uuid": "2bdbe412-bb25-418e-87ac-7edfc51cf3af", "name": "network-vif-plugged", "status": "completed", "tag": "3084d465-862a-4dca-ba25-6a98d0b14fbb"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:02:58.228324 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 3084d465-862a-4dca-ba25-6a98d0b14fbb, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=3084d465-862a-4dca-ba25-6a98d0b14fbb,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:02:58.261238 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:02:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d07f8a6c-37fd-4221-a721-652eba5470fc x-openstack-request-id: req-d07f8a6c-37fd-4221-a721-652eba5470fc {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:02:58.261543 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2bdbe412-bb25-418e-87ac-7edfc51cf3af", "name": "network-vif-plugged", "status": "completed", "tag": "3084d465-862a-4dca-ba25-6a98d0b14fbb", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:02:58.261995 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-d07f8a6c-37fd-4221-a721-652eba5470fc {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:02:58.262415 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3084d465-862a-4dca-ba25-6a98d0b14fbb', 'code': 200} Jun 17 11:02:58.276472 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-e231f93e-92ee-42dc-a763-afba4495ec00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:58.278005 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-e231f93e-92ee-42dc-a763-afba4495ec00 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=639911d94d744c97a47444f2f5785c40&device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 1097 time: 0.0573113 Jun 17 11:02:58.291057 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:02:58.293106 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:02:58.320297 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-ecdaec94-595c-4fc5-a7a1-b870b3a7c198 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=316b36b2-c75c-42ff-9b5d-368f0037bc5d HTTP/1.1" status: 200 len: 217 time: 0.0348754 Jun 17 11:02:58.373070 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=3084d465-862a-4dca-ba25-6a98d0b14fbb,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:02:58.384170 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.384520 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.384859 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.385192 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.385521 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.385849 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.386178 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.386499 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.387289 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.387289 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.387571 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.387891 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:02:58.392578 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:02:58.395595 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-e6d17476-1bde-42a2-bf14-a91b8252fecb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:58.397093 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-e6d17476-1bde-42a2-bf14-a91b8252fecb service neutron] 10.222.0.25 "GET /v2.0/subnets?id=4f767ce8-3cfb-498b-9928-86e92efe06d9 HTTP/1.1" status: 200 len: 854 time: 0.0632012 Jun 17 11:02:58.434512 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-53302b39-dd7a-449a-9a18-4305d1785261 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ac073896-1dc1-4a1c-bbb5-f73d05a0f328&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0304005 Jun 17 11:02:58.521532 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-497b8eff-74c5-4a79-b2a3-0d3476dabd32 service neutron] 10.222.0.25 "GET /v2.0/networks/ac073896-1dc1-4a1c-bbb5-f73d05a0f328?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798409 Jun 17 11:02:58.620702 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-451b42f1-19ec-4406-9a06-6f466f8aa7f0 req-5f277f25-ee5b-4df0-aae4-030246483815 service neutron] 10.222.0.25 "GET /v2.0/networks/ac073896-1dc1-4a1c-bbb5-f73d05a0f328?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883296 Jun 17 11:02:58.736629 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3154247-d5e4-492a-b285-30b6681b9896 req-930831d7-cf1b-46b3-964b-0278eb41c225 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:58.738688 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b3154247-d5e4-492a-b285-30b6681b9896 req-930831d7-cf1b-46b3-964b-0278eb41c225 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 1098 time: 0.0530941 Jun 17 11:02:58.776200 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b3154247-d5e4-492a-b285-30b6681b9896 req-127b266f-b917-48ac-969e-5bf3b39de21b service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0300612 Jun 17 11:02:58.932317 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a086470-44f6-4fc5-bdfb-cccb989c3f36 req-b54d97f6-2f73-49df-b1de-6217b7e260e0 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:58.933791 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2a086470-44f6-4fc5-bdfb-cccb989c3f36 req-b54d97f6-2f73-49df-b1de-6217b7e260e0 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 944 time: 0.0663035 Jun 17 11:02:58.972808 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2a086470-44f6-4fc5-bdfb-cccb989c3f36 req-a1dec0ff-c3ec-4706-995a-ea3c8a3ff499 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322123 Jun 17 11:02:58.987677 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47dbf79a-890e-445b-adc1-657e435be3e3 req-4d385733-1bb5-4d0e-9d6d-31cb719eb360 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:58.989162 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-47dbf79a-890e-445b-adc1-657e435be3e3 req-4d385733-1bb5-4d0e-9d6d-31cb719eb360 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 945 time: 0.0650151 Jun 17 11:02:59.025839 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-47dbf79a-890e-445b-adc1-657e435be3e3 req-55f9b847-482c-4c33-93be-0ada1e1b0a15 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312090 Jun 17 11:02:59.191359 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6290fe87-77c5-48a9-aa73-bc9e5c4702d3 req-bcf4bb76-af60-4f45-a078-6f0375808257 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:02:59.198158 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6290fe87-77c5-48a9-aa73-bc9e5c4702d3 req-bcf4bb76-af60-4f45-a078-6f0375808257 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0612936 Jun 17 11:02:59.230590 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6290fe87-77c5-48a9-aa73-bc9e5c4702d3 req-021511db-589b-45ac-90c6-73240ecfa722 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319395 Jun 17 11:03:00.154136 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb83aba7-114c-4b1f-8779-68db84fcbc4b req-2725b8a4-1bb2-46fe-bd1e-228225a462c8 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:00.155631 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fb83aba7-114c-4b1f-8779-68db84fcbc4b req-2725b8a4-1bb2-46fe-bd1e-228225a462c8 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 944 time: 0.0675659 Jun 17 11:03:00.193099 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fb83aba7-114c-4b1f-8779-68db84fcbc4b req-06df7a91-9bc7-45d6-a308-9ae93acb02c4 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312862 Jun 17 11:03:00.207514 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fda5d9a8-6da2-4df3-a212-6bf763e94042 req-2dbe13b2-414a-46ea-87d4-43d91d2c74ad tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:00.208992 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fda5d9a8-6da2-4df3-a212-6bf763e94042 req-2dbe13b2-414a-46ea-87d4-43d91d2c74ad tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 945 time: 0.0703485 Jun 17 11:03:00.246526 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fda5d9a8-6da2-4df3-a212-6bf763e94042 req-20de8d26-62db-4162-9ff8-603c31f97680 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316484 Jun 17 11:03:00.411560 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb4521d-d6d5-4f41-bc50-9728c3f6672d req-0c77d639-fbac-4493-a1ba-1bc2bb864470 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:00.413064 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7eb4521d-d6d5-4f41-bc50-9728c3f6672d req-0c77d639-fbac-4493-a1ba-1bc2bb864470 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0703995 Jun 17 11:03:00.463478 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7eb4521d-d6d5-4f41-bc50-9728c3f6672d req-ddfec359-e2fd-42de-bf27-a814bdfee3c1 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419860 Jun 17 11:03:01.367508 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83f55717-5103-4bdb-8c6f-7788606ed1bf req-7d84e7cd-9364-4157-bf1d-ab2464cc5810 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:01.369011 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83f55717-5103-4bdb-8c6f-7788606ed1bf req-7d84e7cd-9364-4157-bf1d-ab2464cc5810 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 944 time: 0.0633020 Jun 17 11:03:01.412949 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83f55717-5103-4bdb-8c6f-7788606ed1bf req-ef3c9167-e888-44ee-90a8-e290fba9654a tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373466 Jun 17 11:03:01.550728 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-651bd997-fc25-42ac-b08e-dba225ae4ffb req-c83f0956-3b45-45b4-b4f3-d78454373314 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:01.552443 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-651bd997-fc25-42ac-b08e-dba225ae4ffb req-c83f0956-3b45-45b4-b4f3-d78454373314 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 945 time: 0.0691006 Jun 17 11:03:01.598117 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-651bd997-fc25-42ac-b08e-dba225ae4ffb req-eefc4c49-aa8f-4f1b-9f44-60d4cedb7e2c tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394351 Jun 17 11:03:01.656408 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c764dc9c-272e-421e-a9a2-9c86a9329e6c req-811bc3b1-9046-48ac-9dd2-49f9022a1ba3 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:01.657874 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c764dc9c-272e-421e-a9a2-9c86a9329e6c req-811bc3b1-9046-48ac-9dd2-49f9022a1ba3 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0802002 Jun 17 11:03:01.697740 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c764dc9c-272e-421e-a9a2-9c86a9329e6c req-ebcd5b97-ac1f-4bdc-a0d0-e3bb70d07d86 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328357 Jun 17 11:03:01.781984 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d942e28-bdd2-43e8-b0e2-61e3ed65ee8c req-b1078e0d-8855-4911-a630-a0c82a0003d3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:01.783459 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7d942e28-bdd2-43e8-b0e2-61e3ed65ee8c req-b1078e0d-8855-4911-a630-a0c82a0003d3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 945 time: 0.0689147 Jun 17 11:03:01.821282 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7d942e28-bdd2-43e8-b0e2-61e3ed65ee8c req-742cb2e7-080d-4735-bd54-aa0aab18b243 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321143 Jun 17 11:03:01.850225 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 36800) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:02.053066 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ae9f11f-46c2-416d-9396-5c65190a2278 tempest-TestShelveInstance-322972857 tempest-TestShelveInstance-322972857-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:02.054699 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-7ae9f11f-46c2-416d-9396-5c65190a2278 tempest-TestShelveInstance-322972857 tempest-TestShelveInstance-322972857-project-admin] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 1093 time: 0.2034304 Jun 17 11:03:02.057636 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 36806) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:02.061916 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Request body: {'floatingip': {'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'port_id': '3084d465-862a-4dca-ba25-6a98d0b14fbb', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'fixed_ip_address': '172.20.0.7'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:03:02.176027 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for floatingip, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:02.272343 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:02.373663 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Allocated IP 172.27.3.162 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/464b26bf-d470-4de2-8c8d-afb7a40dae26) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:03:02.483773 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:02.597503 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91908f25-0847-4f5c-b50c-398b9b4233e6 req-ba1941d3-3fc7-49d8-832e-527da0e8fc01 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:02.598962 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-91908f25-0847-4f5c-b50c-398b9b4233e6 req-ba1941d3-3fc7-49d8-832e-527da0e8fc01 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 944 time: 0.0598824 Jun 17 11:03:02.636834 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-91908f25-0847-4f5c-b50c-398b9b4233e6 req-cc66c480-4e4b-4a55-8b40-f851c58bdcd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320244 Jun 17 11:03:02.639473 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:02.644224 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:02.683914 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:03:02.686722 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:02.692897 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:03:02.714271 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event updated for resources: {'Port': ['ID=464b26bf-d470-4de2-8c8d-afb7a40dae26,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:02.726996 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.727329 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.727948 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.728047 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.728357 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.728700 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.729043 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.729381 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.729717 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.730053 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.730388 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.730722 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:02.735503 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:02.872854 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1241ae91-c309-428b-9af1-3bd52d49ca6a req-abbdc0dc-22f0-4b1c-be9c-8903b1471cab tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:02.874328 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1241ae91-c309-428b-9af1-3bd52d49ca6a req-abbdc0dc-22f0-4b1c-be9c-8903b1471cab tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0621331 Jun 17 11:03:02.913094 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1241ae91-c309-428b-9af1-3bd52d49ca6a req-7d577885-b697-49c9-996c-62b03e251cb2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317478 Jun 17 11:03:03.395273 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for floatingip, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:03.582936 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:03.732494 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:03.814591 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:03.814591 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-604d053c-a56e-4940-b5b0-aca51695fc82 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:03.819569 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ef3653-a84e-4bc6-9416-ee43e4d197b3 req-eb6d60ca-7ce8-4265-bd69-a841e8e02542 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:03.821067 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-00ef3653-a84e-4bc6-9416-ee43e4d197b3 req-eb6d60ca-7ce8-4265-bd69-a841e8e02542 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 944 time: 0.0692952 Jun 17 11:03:03.863198 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-00ef3653-a84e-4bc6-9416-ee43e4d197b3 req-906e5f45-923a-42a1-b085-c9528eaea36e tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361876 Jun 17 11:03:03.887956 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event updated for resources: {'Port': ['ID=464b26bf-d470-4de2-8c8d-afb7a40dae26,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:03.890949 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:03.896712 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:03.997306 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 316b36b2-c75c-42ff-9b5d-368f0037bc5d details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:03:04.003279 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.l3_db [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Floating IP 5b1a7bf4-e4c8-4ee0-8e31-61f24c4aa224 associated. External IP: 172.27.3.162, port: 3084d465-862a-4dca-ba25-6a98d0b14fbb. Jun 17 11:03:04.093108 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 316b36b2-c75c-42ff-9b5d-368f0037bc5d, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=316b36b2-c75c-42ff-9b5d-368f0037bc5d,segment=NetworkSegment(b30833e2-269b-473f-8667-473b40248da0),segment_id=b30833e2-269b-473f-8667-473b40248da0)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:04.105484 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '316b36b2-c75c-42ff-9b5d-368f0037bc5d', 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328', 'port_id': '316b36b2-c75c-42ff-9b5d-368f0037bc5d', 'mac_address': 'fa:16:3e:ca:24:60', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 115, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4f767ce8-3cfb-498b-9928-86e92efe06d9', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:03:04.148535 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:04.156939 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ec1bf7-bf32-4f5e-b9cb-37b11bf4132d req-5fd222e2-8083-4a9f-898a-a361e579fce3 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:04.158588 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-77ec1bf7-bf32-4f5e-b9cb-37b11bf4132d req-5fd222e2-8083-4a9f-898a-a361e579fce3 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.1212587 Jun 17 11:03:04.161574 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 316b36b2-c75c-42ff-9b5d-368f0037bc5d {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:03:04.187263 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 316b36b2-c75c-42ff-9b5d-368f0037bc5d, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=316b36b2-c75c-42ff-9b5d-368f0037bc5d,segment=NetworkSegment(b30833e2-269b-473f-8667-473b40248da0),segment_id=b30833e2-269b-473f-8667-473b40248da0)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:04.281591 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-77ec1bf7-bf32-4f5e-b9cb-37b11bf4132d req-02fbca6e-aad9-4f00-8b34-a1d097173630 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748668 Jun 17 11:03:04.323462 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:03:04.370599 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:04.372482 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:04.418639 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=316b36b2-c75c-42ff-9b5d-368f0037bc5d,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:04.421866 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:04.427467 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:03:04.436867 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28fab427-0467-4c7a-9488-fd4dda502921 None None] Sync routers for ids ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:03:04.445998 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28fab427-0467-4c7a-9488-fd4dda502921 None None] Routers {'08615a68-3696-4e03-8e4f-ea190d5c9ca6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:03:04.446667 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-28fab427-0467-4c7a-9488-fd4dda502921 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:02:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:04.593135 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:04.626538 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-28fab427-0467-4c7a-9488-fd4dda502921 None None] Set router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:03:04.648467 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5763345 Jun 17 11:03:04.648467 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'tag': '3084d465-862a-4dca-ba25-6a98d0b14fbb'}] {{(pid=110214) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:03:04.648467 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cc2cf72888dbbd14a3b8c118b05d43e907687f619eecab2abc2da29781eba8b9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-466782ad-e284-416d-a2de-6ccb7640fd49" -d '{"events": [{"name": "network-changed", "server_uuid": "2bdbe412-bb25-418e-87ac-7edfc51cf3af", "tag": "3084d465-862a-4dca-ba25-6a98d0b14fbb"}]}' {{(pid=110214) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:03:04.681621 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:03:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9bf0e88c-5898-405e-99bf-3b46611f4658 x-openstack-request-id: req-9bf0e88c-5898-405e-99bf-3b46611f4658 {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:03:04.682265 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2bdbe412-bb25-418e-87ac-7edfc51cf3af", "tag": "3084d465-862a-4dca-ba25-6a98d0b14fbb", "status": "completed", "code": 200}]} {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:03:04.682418 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-9bf0e88c-5898-405e-99bf-3b46611f4658 {{(pid=110214) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:03:04.682835 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'tag': '3084d465-862a-4dca-ba25-6a98d0b14fbb', 'status': 'completed', 'code': 200} Jun 17 11:03:04.771458 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-466782ad-e284-416d-a2de-6ccb7640fd49 req-3ba8ee68-9cb9-4ca7-82c3-17a341fcb856 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:04.773056 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-466782ad-e284-416d-a2de-6ccb7640fd49 req-3ba8ee68-9cb9-4ca7-82c3-17a341fcb856 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=6c4c0226eef34f24a2c7072aba63129d&device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 1098 time: 0.0564592 Jun 17 11:03:04.848274 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['316b36b2-c75c-42ff-9b5d-368f0037bc5d'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:03:04.851976 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-28fab427-0467-4c7a-9488-fd4dda502921 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:07Z', 'revision_number': 4, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '5b1a7bf4-e4c8-4ee0-8e31-61f24c4aa224', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'floating_ip_address': '172.27.3.162', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'port_id': '3084d465-862a-4dca-ba25-6a98d0b14fbb', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 426, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'mac_address': 'fa:16:3e:fe:01:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:03:02Z', 'updated_at': '2021-06-17T11:03:02Z', 'revision_number': 0, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae16d63a-186a-4b08-82b7-cde98ae2f1d5', 'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'mac_address': 'fa:16:3e:f6:74:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_interface', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:05Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 5, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'subnets': [{'id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:04.887737 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-466782ad-e284-416d-a2de-6ccb7640fd49 req-554d35f2-1e6e-4fe6-b96c-c393fb52269f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:04.887737 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-466782ad-e284-416d-a2de-6ccb7640fd49 req-554d35f2-1e6e-4fe6-b96c-c393fb52269f service neutron] 10.222.0.25 "GET /v2.0/networks?id=16bcab5c-7033-4cca-98e1-b173b2d78c2f HTTP/1.1" status: 200 len: 908 time: 0.0998409 Jun 17 11:03:04.888405 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28fab427-0467-4c7a-9488-fd4dda502921 None None] Checking router: 08615a68-3696-4e03-8e4f-ea190d5c9ca6 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:03:04.895556 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28fab427-0467-4c7a-9488-fd4dda502921 None None] Routers {'08615a68-3696-4e03-8e4f-ea190d5c9ca6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:03:04.896178 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-28fab427-0467-4c7a-9488-fd4dda502921 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:02:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:04.963392 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-466782ad-e284-416d-a2de-6ccb7640fd49 req-379a8d00-ef87-4400-ba1a-c84b4bccb952 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3084d465-862a-4dca-ba25-6a98d0b14fbb HTTP/1.1" status: 200 len: 999 time: 0.0740457 Jun 17 11:03:05.031874 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-28fab427-0467-4c7a-9488-fd4dda502921 None None] Set router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:03:05.104289 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-466782ad-e284-416d-a2de-6ccb7640fd49 req-b5d1ac15-29a7-4f76-930e-e4db4b40c447 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:05.105794 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-466782ad-e284-416d-a2de-6ccb7640fd49 req-b5d1ac15-29a7-4f76-930e-e4db4b40c447 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2567fd48-9bd6-4ffa-9d4c-72f989266554 HTTP/1.1" status: 200 len: 846 time: 0.1346371 Jun 17 11:03:05.142387 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37267b08-7979-4bfd-bcd4-5e332697e8b6 req-aa657df1-f1d3-4fd5-99d1-5bb64e5580e4 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:05.143832 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-37267b08-7979-4bfd-bcd4-5e332697e8b6 req-aa657df1-f1d3-4fd5-99d1-5bb64e5580e4 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 945 time: 0.1162765 Jun 17 11:03:05.201782 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-37267b08-7979-4bfd-bcd4-5e332697e8b6 req-eef52f57-eb76-4067-be1c-31cb2d0d06c8 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421834 Jun 17 11:03:05.215599 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-466782ad-e284-416d-a2de-6ccb7640fd49 req-fcb0467c-b62e-4346-b800-f0250d549dcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:05.217318 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-466782ad-e284-416d-a2de-6ccb7640fd49 req-fcb0467c-b62e-4346-b800-f0250d549dcd service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=16bcab5c-7033-4cca-98e1-b173b2d78c2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0974641 Jun 17 11:03:05.278168 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-28fab427-0467-4c7a-9488-fd4dda502921 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:07Z', 'revision_number': 4, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '5b1a7bf4-e4c8-4ee0-8e31-61f24c4aa224', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'floating_ip_address': '172.27.3.162', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'port_id': '3084d465-862a-4dca-ba25-6a98d0b14fbb', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 426, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'mac_address': 'fa:16:3e:fe:01:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:03:02Z', 'updated_at': '2021-06-17T11:03:02Z', 'revision_number': 0, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae16d63a-186a-4b08-82b7-cde98ae2f1d5', 'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'mac_address': 'fa:16:3e:f6:74:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_interface', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:05Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 5, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'subnets': [{'id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:05.303979 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28fab427-0467-4c7a-9488-fd4dda502921 None None] The sync data for ids ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'] in dv-cinder-773870-6-iscsi is: [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:07Z', 'revision_number': 4, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '5b1a7bf4-e4c8-4ee0-8e31-61f24c4aa224', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'floating_ip_address': '172.27.3.162', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'port_id': '3084d465-862a-4dca-ba25-6a98d0b14fbb', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 426, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'mac_address': 'fa:16:3e:fe:01:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:03:02Z', 'updated_at': '2021-06-17T11:03:02Z', 'revision_number': 0, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ae16d63a-186a-4b08-82b7-cde98ae2f1d5', 'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'mac_address': 'fa:16:3e:f6:74:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_interface', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:05Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 5, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'subnets': [{'id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:03:05.315192 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-466782ad-e284-416d-a2de-6ccb7640fd49 req-e139e774-14ad-4def-b6ac-aec080c508d5 service neutron] 10.222.0.25 "GET /v2.0/networks/16bcab5c-7033-4cca-98e1-b173b2d78c2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852852 Jun 17 11:03:05.417855 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-466782ad-e284-416d-a2de-6ccb7640fd49 req-f8e0f6da-e5a1-4e8c-836a-76601059759f service neutron] 10.222.0.25 "GET /v2.0/networks/16bcab5c-7033-4cca-98e1-b173b2d78c2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0944347 Jun 17 11:03:05.554713 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ca4b29-e75b-402d-a342-72f2b2f2dea4 req-1ee97f61-b5c1-47b1-a0a7-521561435b52 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:05.556293 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-92ca4b29-e75b-402d-a342-72f2b2f2dea4 req-1ee97f61-b5c1-47b1-a0a7-521561435b52 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0723901 Jun 17 11:03:05.572498 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f6a48db-a272-474c-97a1-0f71182db4be None None] New status for floating IP 5b1a7bf4-e4c8-4ee0-8e31-61f24c4aa224: ACTIVE {{(pid=110216) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:03:05.607392 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-92ca4b29-e75b-402d-a342-72f2b2f2dea4 req-f547fd4b-733b-4cf3-a905-a8d3adc0c9c8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452623 Jun 17 11:03:05.632509 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf92e00-5d41-4d7c-8219-cf2a50708b11 req-bab6784b-4e9b-40c6-a33d-39ac3a4b164d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:05.634370 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-dbf92e00-5d41-4d7c-8219-cf2a50708b11 req-bab6784b-4e9b-40c6-a33d-39ac3a4b164d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 946 time: 0.0795114 Jun 17 11:03:05.681447 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-dbf92e00-5d41-4d7c-8219-cf2a50708b11 req-65312eb9-52c2-4a6f-a688-69394526e051 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394926 Jun 17 11:03:06.383417 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-700b8f23-5519-492f-a677-0c76d3cbbe5f req-d08cefa5-17c3-4cd4-affb-8be75bc7ff21 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:06.384856 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-700b8f23-5519-492f-a677-0c76d3cbbe5f req-d08cefa5-17c3-4cd4-affb-8be75bc7ff21 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 945 time: 0.0658584 Jun 17 11:03:06.422982 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-700b8f23-5519-492f-a677-0c76d3cbbe5f req-3c7cd679-a22f-443c-a560-f8d45f5ee604 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322959 Jun 17 11:03:06.792060 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80dfd33-1c41-4c2d-bafd-c111363987ed req-9a1e18b7-61b6-4d83-99fb-8200d3b8c3c0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:06.793565 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f80dfd33-1c41-4c2d-bafd-c111363987ed req-9a1e18b7-61b6-4d83-99fb-8200d3b8c3c0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0666771 Jun 17 11:03:06.821709 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:06.833563 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f80dfd33-1c41-4c2d-bafd-c111363987ed req-6af2f436-9905-464a-b87b-8b3a9bf7a1d7 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333197 Jun 17 11:03:06.881087 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-066c22db-2729-45c0-b1d0-5a5afa0b3936 req-0a97a1f3-35f7-40cc-a107-bf6122d2bf6a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:06.882549 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-066c22db-2729-45c0-b1d0-5a5afa0b3936 req-0a97a1f3-35f7-40cc-a107-bf6122d2bf6a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 946 time: 0.0736113 Jun 17 11:03:06.919791 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-066c22db-2729-45c0-b1d0-5a5afa0b3936 req-1e47a9a2-93fc-4e00-b833-4a71f52e5cdb tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0307405 Jun 17 11:03:07.600508 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11f36033-3d27-4c60-9766-ac171b612b66 req-588402d9-87e3-4d99-96a4-9395ce8c9453 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:07.601974 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-11f36033-3d27-4c60-9766-ac171b612b66 req-588402d9-87e3-4d99-96a4-9395ce8c9453 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 945 time: 0.0661213 Jun 17 11:03:07.640242 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-11f36033-3d27-4c60-9766-ac171b612b66 req-fff8d327-23c9-479b-acee-13394e48920d tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325351 Jun 17 11:03:07.928211 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c446596b-1ec1-4ff5-95bd-13720d7b6cbc req-9d1887a3-621d-4d49-b724-0e0f5814d371 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:07.929629 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c446596b-1ec1-4ff5-95bd-13720d7b6cbc req-9d1887a3-621d-4d49-b724-0e0f5814d371 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 946 time: 0.0613897 Jun 17 11:03:07.995039 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 316b36b2-c75c-42ff-9b5d-368f0037bc5d up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:08.021194 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dee96d-0e5d-4340-a7b3-d319e1f2cc45 req-5169ceef-493a-45e0-8779-782758173a3b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:08.028752 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-75dee96d-0e5d-4340-a7b3-d319e1f2cc45 req-5169ceef-493a-45e0-8779-782758173a3b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0762136 Jun 17 11:03:08.063758 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-75dee96d-0e5d-4340-a7b3-d319e1f2cc45 req-91b58b55-f873-495e-bcd7-e36426158e33 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339119 Jun 17 11:03:08.096057 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 316b36b2-c75c-42ff-9b5d-368f0037bc5d completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:08.100671 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 316b36b2-c75c-42ff-9b5d-368f0037bc5d triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:08.101061 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:08.112253 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-c446596b-1ec1-4ff5-95bd-13720d7b6cbc req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Deleting port 7f393d5b-3d64-445d-8452-77f330f822c4 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:03:08.112778 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-c446596b-1ec1-4ff5-95bd-13720d7b6cbc req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:08.146413 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30855d38-1c85-4b58-8716-fd720988e723 req-ed8f461e-ee89-4b6e-96d8-b288348aab3d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:08.147991 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-30855d38-1c85-4b58-8716-fd720988e723 req-ed8f461e-ee89-4b6e-96d8-b288348aab3d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 946 time: 0.1043956 Jun 17 11:03:08.182748 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:08.206771 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ad131e18-76ae-4d60-8e93-58748c554d77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '316b36b2-c75c-42ff-9b5d-368f0037bc5d'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:03:08.209132 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5bfca58-b43d-4334-b596-1e9fc8f5a295" -d '{"events": [{"server_uuid": "ad131e18-76ae-4d60-8e93-58748c554d77", "name": "network-vif-plugged", "status": "completed", "tag": "316b36b2-c75c-42ff-9b5d-368f0037bc5d"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:03:08.223770 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 316b36b2-c75c-42ff-9b5d-368f0037bc5d, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=316b36b2-c75c-42ff-9b5d-368f0037bc5d,segment=NetworkSegment(b30833e2-269b-473f-8667-473b40248da0),segment_id=b30833e2-269b-473f-8667-473b40248da0)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:08.247692 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:03:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9bf1e460-8a50-484c-999a-d9ef63a71c99 x-openstack-request-id: req-9bf1e460-8a50-484c-999a-d9ef63a71c99 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:03:08.247990 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ad131e18-76ae-4d60-8e93-58748c554d77", "name": "network-vif-plugged", "status": "completed", "tag": "316b36b2-c75c-42ff-9b5d-368f0037bc5d", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:03:08.248274 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-9bf1e460-8a50-484c-999a-d9ef63a71c99 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:03:08.248712 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ad131e18-76ae-4d60-8e93-58748c554d77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '316b36b2-c75c-42ff-9b5d-368f0037bc5d', 'code': 200} Jun 17 11:03:08.285939 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:08.288562 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:08.345270 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=316b36b2-c75c-42ff-9b5d-368f0037bc5d,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:08.349332 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:08.473505 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-30855d38-1c85-4b58-8716-fd720988e723 req-0dbf7138-bc4e-4b4e-abd5-d032bdb95821 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3188233 Jun 17 11:03:08.485382 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-c446596b-1ec1-4ff5-95bd-13720d7b6cbc req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] For port 7f393d5b-3d64-445d-8452-77f330f822c4, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=7f393d5b-3d64-445d-8452-77f330f822c4,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:08.485748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-c446596b-1ec1-4ff5-95bd-13720d7b6cbc req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:08.552823 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-c446596b-1ec1-4ff5-95bd-13720d7b6cbc req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Calling delete_port for 7f393d5b-3d64-445d-8452-77f330f822c4 owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:03:08.663766 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80b5d038-8ea4-4588-ae9d-55c2c131c3d2 req-2c0b0f07-7ce3-4d56-a53d-8c2841181188 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:08.665328 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-80b5d038-8ea4-4588-ae9d-55c2c131c3d2 req-2c0b0f07-7ce3-4d56-a53d-8c2841181188 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 1099 time: 0.1103477 Jun 17 11:03:08.752703 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-80b5d038-8ea4-4588-ae9d-55c2c131c3d2 req-44d4345e-cf8a-480d-bbff-dc02143e6185 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759189 Jun 17 11:03:08.839075 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-c446596b-1ec1-4ff5-95bd-13720d7b6cbc req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:08.843495 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:08.843647 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93ad88ef-d05c-4ea8-a699-ba9f4dfe4d74 req-26a7bb6d-0c9a-40cd-ae40-ec9fe3c6dff7 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:08.845019 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-93ad88ef-d05c-4ea8-a699-ba9f4dfe4d74 req-26a7bb6d-0c9a-40cd-ae40-ec9fe3c6dff7 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0626712 Jun 17 11:03:08.850422 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5df2bc70-d7c4-4355-b3d7-81d2732dfd9d', 'b9d0052c-f650-4dae-8e30-09f806a67cfb', 'ab14f0f0-986e-47dd-a78c-224cbab21a85', '7f393d5b-3d64-445d-8452-77f330f822c4'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:03:08.869062 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Pushing event deleted for resources: {'Port': ['ID=7f393d5b-3d64-445d-8452-77f330f822c4,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:08.872620 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:08.897341 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-93ad88ef-d05c-4ea8-a699-ba9f4dfe4d74 req-64ebb3a6-3d03-415c-965e-fd1757897dcb tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443423 Jun 17 11:03:08.921540 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-c446596b-1ec1-4ff5-95bd-13720d7b6cbc req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] No DVR routers for this DVR port 7f393d5b-3d64-445d-8452-77f330f822c4 on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:03:08.922234 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-c446596b-1ec1-4ff5-95bd-13720d7b6cbc req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:08.924894 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c446596b-1ec1-4ff5-95bd-13720d7b6cbc req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "DELETE /v2.0/ports/7f393d5b-3d64-445d-8452-77f330f822c4 HTTP/1.1" status: 204 len: 173 time: 0.9826849 Jun 17 11:03:08.925406 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e92f4703-97e8-4a42-84dd-eaab237e23e3', 'name': 'network-vif-deleted', 'tag': '7f393d5b-3d64-445d-8452-77f330f822c4'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:03:08.927765 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6165959-97ba-4c83-8a94-335087abdb15" -d '{"events": [{"server_uuid": "e92f4703-97e8-4a42-84dd-eaab237e23e3", "name": "network-vif-deleted", "tag": "7f393d5b-3d64-445d-8452-77f330f822c4"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:03:08.962965 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:03:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea0d12b9-68ba-4768-9b59-c0868f31d10c x-openstack-request-id: req-ea0d12b9-68ba-4768-9b59-c0868f31d10c {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:03:08.963686 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e92f4703-97e8-4a42-84dd-eaab237e23e3", "name": "network-vif-deleted", "tag": "7f393d5b-3d64-445d-8452-77f330f822c4", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:03:08.963686 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-ea0d12b9-68ba-4768-9b59-c0868f31d10c {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:03:08.963960 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e92f4703-97e8-4a42-84dd-eaab237e23e3', 'name': 'network-vif-deleted', 'tag': '7f393d5b-3d64-445d-8452-77f330f822c4', 'status': 'completed', 'code': 200} Jun 17 11:03:09.251772 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f14c82fd-070e-49a0-adab-41daafdd46a0 req-ba7d3f1a-a94f-4f4e-8f98-644dce04793b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:09.253789 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f14c82fd-070e-49a0-adab-41daafdd46a0 req-ba7d3f1a-a94f-4f4e-8f98-644dce04793b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0684118 Jun 17 11:03:09.292327 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f14c82fd-070e-49a0-adab-41daafdd46a0 req-cf505d3c-62e9-42eb-bcf3-5f5db15098b2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327303 Jun 17 11:03:09.632658 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-de36dbb0-ea1f-4ab0-9ff1-409f8b290a3a req-2c9d0a77-5221-44d2-9b4b-6daa1e80ee8f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 210 time: 0.0317483 Jun 17 11:03:10.073959 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea70d210-d63d-442e-ad34-b9b2bd0d7650 req-e9b26c96-138d-46a0-8496-8a70d4163fad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:10.075480 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ea70d210-d63d-442e-ad34-b9b2bd0d7650 req-e9b26c96-138d-46a0-8496-8a70d4163fad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0627861 Jun 17 11:03:10.120631 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ea70d210-d63d-442e-ad34-b9b2bd0d7650 req-760876c3-f2d0-4092-b158-84c7547129ce tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393333 Jun 17 11:03:10.473083 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6f5f9bb-0b31-4dd2-a4ad-ae5527cd71dc req-316da009-b060-48ff-95c7-70509b701840 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:10.476117 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f6f5f9bb-0b31-4dd2-a4ad-ae5527cd71dc req-316da009-b060-48ff-95c7-70509b701840 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0757458 Jun 17 11:03:10.515322 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f6f5f9bb-0b31-4dd2-a4ad-ae5527cd71dc req-82188112-9eba-48d5-a7f0-0b9a7d38add6 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316436 Jun 17 11:03:10.790773 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-113510a8-0962-47ef-9bd1-370ca160a45f req-de7cb4f5-7e71-4ff1-b8b2-5a4743f424e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 210 time: 0.0288367 Jun 17 11:03:11.290959 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d87fc95-25b4-41d7-b9bf-c0552a9570eb req-5952250c-82cd-47f1-8468-f62c64585cf1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:11.292896 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7d87fc95-25b4-41d7-b9bf-c0552a9570eb req-5952250c-82cd-47f1-8468-f62c64585cf1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0633523 Jun 17 11:03:11.331968 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd5f1616-f849-4b43-b5bc-2dbdf028660e req-4a042e18-fe27-4ed2-98c9-24dd96b5aa12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:11.333244 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7d87fc95-25b4-41d7-b9bf-c0552a9570eb req-38fc929d-38c9-4b4b-99f4-dee7cca9d90c tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347288 Jun 17 11:03:11.333464 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fd5f1616-f849-4b43-b5bc-2dbdf028660e req-4a042e18-fe27-4ed2-98c9-24dd96b5aa12 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 1098 time: 0.0531666 Jun 17 11:03:11.693089 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d487260e-d411-43da-9693-081907f06e1a req-8d9f0f0b-c7a0-4182-a945-d195bfbc2663 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:11.694553 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d487260e-d411-43da-9693-081907f06e1a req-8d9f0f0b-c7a0-4182-a945-d195bfbc2663 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0654633 Jun 17 11:03:11.732145 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d487260e-d411-43da-9693-081907f06e1a req-96baaa41-8f75-4ce1-aaea-753c1bf0fa7a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316615 Jun 17 11:03:11.949169 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-74dad921-c9bc-4fd6-b8b6-e826e09f7150 req-2a6c2729-a968-46b6-9d42-d005549c57ba tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 210 time: 0.0284023 Jun 17 11:03:12.483711 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fd5f1616-f849-4b43-b5bc-2dbdf028660e req-1a6a3dc3-f070-4575-bcfe-b8e323d8e104 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382109 Jun 17 11:03:12.503966 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-154b8b60-6a1a-4b40-9eb7-64bb7a2edf18 req-41446cc9-5f53-45a9-83b6-bdaf03114f18 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:12.505428 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-154b8b60-6a1a-4b40-9eb7-64bb7a2edf18 req-41446cc9-5f53-45a9-83b6-bdaf03114f18 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0627980 Jun 17 11:03:12.543438 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-154b8b60-6a1a-4b40-9eb7-64bb7a2edf18 req-90b9cd2e-7924-45ce-bc16-70cd51399472 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322843 Jun 17 11:03:12.926274 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525ed950-5474-4043-84d5-7fed08ce8d3b req-3eb3c1ec-cded-4732-83ad-7f48d6a9abc2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:12.927791 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-525ed950-5474-4043-84d5-7fed08ce8d3b req-3eb3c1ec-cded-4732-83ad-7f48d6a9abc2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0648391 Jun 17 11:03:12.965581 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-525ed950-5474-4043-84d5-7fed08ce8d3b req-800d9a99-f8b6-413c-a5f9-1ef241b6d631 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319223 Jun 17 11:03:13.103495 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-01c8d64a-730b-431a-9f06-7cf1167f589b req-71b71ac9-1d39-4825-a9d0-25058d4c9c32 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 210 time: 0.0272388 Jun 17 11:03:13.714874 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263515f3-afb7-4f27-a0a2-3c69046877a8 req-9230ecd0-70c0-4497-9520-1aa29339ee53 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:13.716322 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-263515f3-afb7-4f27-a0a2-3c69046877a8 req-9230ecd0-70c0-4497-9520-1aa29339ee53 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0647633 Jun 17 11:03:13.753904 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-263515f3-afb7-4f27-a0a2-3c69046877a8 req-cf1e72ec-eb4a-48b6-a1b4-caed9259f8d4 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319598 Jun 17 11:03:14.044427 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 7f393d5b-3d64-445d-8452-77f330f822c4 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:03:14.067606 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 7f393d5b-3d64-445d-8452-77f330f822c4 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:03:14.067956 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 7f393d5b-3d64-445d-8452-77f330f822c4 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:03:14.375825 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9826f02a-13c8-4a80-a9e9-65bfdbf50bf8 req-8ffc8b35-d60e-4d37-b087-0a6207866ccc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:14.377857 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9826f02a-13c8-4a80-a9e9-65bfdbf50bf8 req-8ffc8b35-d60e-4d37-b087-0a6207866ccc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.2896521 Jun 17 11:03:14.416276 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9826f02a-13c8-4a80-a9e9-65bfdbf50bf8 req-f0274a70-aeb5-4103-a470-40e68861cd91 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326202 Jun 17 11:03:14.596560 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-65f8eada-7097-4ad9-a572-cb348de21664 req-2d1c9346-73ca-417c-91ff-e463cfdd831f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=e92f4703-97e8-4a42-84dd-eaab237e23e3 HTTP/1.1" status: 200 len: 210 time: 0.0267789 Jun 17 11:03:14.930809 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda26dfd-cf0f-4481-92a4-5c20509f1193 req-d87168c7-38fd-4fd1-8f01-4690adef4150 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:14.933919 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-eda26dfd-cf0f-4481-92a4-5c20509f1193 req-d87168c7-38fd-4fd1-8f01-4690adef4150 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0631881 Jun 17 11:03:14.970153 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-eda26dfd-cf0f-4481-92a4-5c20509f1193 req-28eb74c8-b8da-443e-879e-2d8551e66391 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319629 Jun 17 11:03:15.594171 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47cb2fa-0676-4a97-8341-3776906ecfbf req-58a24676-4ff8-486a-ba80-037f83ff1275 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:15.595649 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a47cb2fa-0676-4a97-8341-3776906ecfbf req-58a24676-4ff8-486a-ba80-037f83ff1275 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0647557 Jun 17 11:03:15.634267 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a47cb2fa-0676-4a97-8341-3776906ecfbf req-e7d5d5a6-cfd1-4b86-a41a-bc43233f1b2b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326040 Jun 17 11:03:16.145014 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a16ef70c-9091-4310-8ced-f26ae3b637ba req-cb1cca4e-1f16-48a3-8142-81c9950608db tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:16.146625 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a16ef70c-9091-4310-8ced-f26ae3b637ba req-cb1cca4e-1f16-48a3-8142-81c9950608db tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0648117 Jun 17 11:03:16.184023 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a16ef70c-9091-4310-8ced-f26ae3b637ba req-a1138c8d-fb50-4664-8f5f-bae6faa9f458 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318234 Jun 17 11:03:16.821856 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fce681b-32a7-4e7a-b4f1-e9258b7692eb req-69cd22b1-bc07-4ce1-a205-b865cf608291 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:16.823334 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1fce681b-32a7-4e7a-b4f1-e9258b7692eb req-69cd22b1-bc07-4ce1-a205-b865cf608291 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0651088 Jun 17 11:03:16.861047 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1fce681b-32a7-4e7a-b4f1-e9258b7692eb req-65508f03-329e-44dc-9435-2b091538e674 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321376 Jun 17 11:03:17.497851 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973cf008-6dd5-48e8-8e2e-7428a3160106 req-4fe8b44b-6874-44da-bf49-c271bc97d208 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:17.505853 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-973cf008-6dd5-48e8-8e2e-7428a3160106 req-4fe8b44b-6874-44da-bf49-c271bc97d208 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0873127 Jun 17 11:03:17.541528 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-973cf008-6dd5-48e8-8e2e-7428a3160106 req-61966583-ed07-4fb4-9c8f-dc6e0ae38fe8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0348139 Jun 17 11:03:17.595139 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d57fe50-0ae4-4f32-886c-22dda3a8ba2a req-256fed89-f369-47e6-a982-a2a6c36efa40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:17.595139 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7d57fe50-0ae4-4f32-886c-22dda3a8ba2a req-256fed89-f369-47e6-a982-a2a6c36efa40 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 1098 time: 0.1067812 Jun 17 11:03:17.595139 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a82bad29-38ac-469a-ae33-eb89ba4720e5 req-85a49fef-3f07-4f63-b712-5a8b2da1de44 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:17.595139 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a82bad29-38ac-469a-ae33-eb89ba4720e5 req-85a49fef-3f07-4f63-b712-5a8b2da1de44 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 945 time: 0.1071031 Jun 17 11:03:17.698368 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a82bad29-38ac-469a-ae33-eb89ba4720e5 req-02efa671-4092-4551-b577-7519da052047 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1157961 Jun 17 11:03:17.723850 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d57fe50-0ae4-4f32-886c-22dda3a8ba2a req-ab1013af-b40f-4454-a198-4f5796b275c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:17.725304 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7d57fe50-0ae4-4f32-886c-22dda3a8ba2a req-ab1013af-b40f-4454-a198-4f5796b275c5 service neutron] 10.222.0.25 "GET /v2.0/networks?id=0fe823e2-06dd-4212-84a6-8e0beda57580 HTTP/1.1" status: 200 len: 920 time: 0.1515365 Jun 17 11:03:17.769264 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7d57fe50-0ae4-4f32-886c-22dda3a8ba2a req-03ce7f34-1caa-4f61-aa50-6d71cc99d628 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2ec3e896-70d1-4c47-933b-7234e4f744ed HTTP/1.1" status: 200 len: 217 time: 0.0343909 Jun 17 11:03:17.831643 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d57fe50-0ae4-4f32-886c-22dda3a8ba2a req-9f739d72-1a43-4ded-a8d7-a1a9a9539457 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:17.833085 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7d57fe50-0ae4-4f32-886c-22dda3a8ba2a req-9f739d72-1a43-4ded-a8d7-a1a9a9539457 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=ab7c7a9f-b422-4b40-b94a-6939be91bbb8 HTTP/1.1" status: 200 len: 859 time: 0.0540383 Jun 17 11:03:17.868819 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7d57fe50-0ae4-4f32-886c-22dda3a8ba2a req-d284bbad-d311-4673-8ea6-fc370660f86b service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0fe823e2-06dd-4212-84a6-8e0beda57580&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0266678 Jun 17 11:03:17.971564 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7d57fe50-0ae4-4f32-886c-22dda3a8ba2a req-4d6847f1-4de8-4690-885f-6af549f84a61 service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863962 Jun 17 11:03:18.075982 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7d57fe50-0ae4-4f32-886c-22dda3a8ba2a req-ca633658-ba42-4092-9fd6-e435a9b035b5 service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0899782 Jun 17 11:03:18.751252 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e524553-68af-4953-97d1-3f43c53f29bc req-8bfba4e0-1d53-4d3d-b24b-547ad4e06d6a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:18.753565 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2e524553-68af-4953-97d1-3f43c53f29bc req-8bfba4e0-1d53-4d3d-b24b-547ad4e06d6a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0744874 Jun 17 11:03:18.795829 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2e524553-68af-4953-97d1-3f43c53f29bc req-83975e1b-edbc-4743-9910-530b684641c8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366695 Jun 17 11:03:18.883478 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a44b136-1334-460b-b0cc-cbd6b8b5a15a req-8591d64c-7344-4a89-a139-869be54a3297 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:18.884919 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8a44b136-1334-460b-b0cc-cbd6b8b5a15a req-8591d64c-7344-4a89-a139-869be54a3297 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 945 time: 0.0654001 Jun 17 11:03:18.922519 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8a44b136-1334-460b-b0cc-cbd6b8b5a15a req-7fa57180-2574-417d-92d7-573ab3132bdc tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318062 Jun 17 11:03:19.981111 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f6a1e3-f166-4053-841c-ff2401e21f34 req-4e64acc7-21ba-41f1-8b9a-aef5c1a872c2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:19.982560 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-92f6a1e3-f166-4053-841c-ff2401e21f34 req-4e64acc7-21ba-41f1-8b9a-aef5c1a872c2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0651321 Jun 17 11:03:20.021742 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-92f6a1e3-f166-4053-841c-ff2401e21f34 req-380f90ca-d255-4e53-a4ca-1506fecd0720 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332696 Jun 17 11:03:20.096728 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bab5a9d-3ca5-4009-974e-e7ae3637fac0 req-7480b3ba-ddb7-49b5-a1c4-59370807e09c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:20.098211 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0bab5a9d-3ca5-4009-974e-e7ae3637fac0 req-7480b3ba-ddb7-49b5-a1c4-59370807e09c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 945 time: 0.0631921 Jun 17 11:03:20.136126 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0bab5a9d-3ca5-4009-974e-e7ae3637fac0 req-f9b62409-f71b-4331-80f9-88c6092891b0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323696 Jun 17 11:03:20.230775 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd93898-0956-43e4-90dd-8f4573b40b72 req-17d6a29f-6a08-4f63-b2fa-e1929063238e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:20.232306 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2cd93898-0956-43e4-90dd-8f4573b40b72 req-17d6a29f-6a08-4f63-b2fa-e1929063238e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 945 time: 0.0679152 Jun 17 11:03:20.344342 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-2cd93898-0956-43e4-90dd-8f4573b40b72 req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Deleting port ab14f0f0-986e-47dd-a78c-224cbab21a85 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:03:20.344737 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-2cd93898-0956-43e4-90dd-8f4573b40b72 req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:20.435210 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-2cd93898-0956-43e4-90dd-8f4573b40b72 req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] For port ab14f0f0-986e-47dd-a78c-224cbab21a85, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=ab14f0f0-986e-47dd-a78c-224cbab21a85,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:20.435574 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-2cd93898-0956-43e4-90dd-8f4573b40b72 req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:20.502046 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-2cd93898-0956-43e4-90dd-8f4573b40b72 req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Calling delete_port for ab14f0f0-986e-47dd-a78c-224cbab21a85 owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:03:20.645426 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-de929991-f54f-4090-9224-e94c27955c08 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:20.700192 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37080) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:20.753748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-2cd93898-0956-43e4-90dd-8f4573b40b72 req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:20.759318 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:20.770084 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5df2bc70-d7c4-4355-b3d7-81d2732dfd9d', 'b9d0052c-f650-4dae-8e30-09f806a67cfb', 'ab14f0f0-986e-47dd-a78c-224cbab21a85'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:03:20.789206 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Pushing event deleted for resources: {'Port': ['ID=ab14f0f0-986e-47dd-a78c-224cbab21a85,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:20.791780 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:20.821041 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a72cae5a-7be9-4c88-ba96-59e4f5a601d8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:20.838459 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-2cd93898-0956-43e4-90dd-8f4573b40b72 req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] No DVR routers for this DVR port ab14f0f0-986e-47dd-a78c-224cbab21a85 on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:03:20.841080 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-2cd93898-0956-43e4-90dd-8f4573b40b72 req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:20.843094 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2cd93898-0956-43e4-90dd-8f4573b40b72 req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "DELETE /v2.0/ports/ab14f0f0-986e-47dd-a78c-224cbab21a85 HTTP/1.1" status: 204 len: 173 time: 0.6043820 Jun 17 11:03:20.843607 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd24ac987-0f9c-4315-a0ec-68765090caf9', 'name': 'network-vif-deleted', 'tag': 'ab14f0f0-986e-47dd-a78c-224cbab21a85'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:03:20.846527 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2008fec9-e685-4938-8c7e-5666a3a779ce" -d '{"events": [{"server_uuid": "d24ac987-0f9c-4315-a0ec-68765090caf9", "name": "network-vif-deleted", "tag": "ab14f0f0-986e-47dd-a78c-224cbab21a85"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:03:20.888956 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:03:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b37df114-dd29-4840-b476-94984a55104b x-openstack-request-id: req-b37df114-dd29-4840-b476-94984a55104b {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:03:20.889893 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d24ac987-0f9c-4315-a0ec-68765090caf9", "name": "network-vif-deleted", "tag": "ab14f0f0-986e-47dd-a78c-224cbab21a85", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:03:20.890582 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-b37df114-dd29-4840-b476-94984a55104b {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:03:20.891314 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd24ac987-0f9c-4315-a0ec-68765090caf9', 'name': 'network-vif-deleted', 'tag': 'ab14f0f0-986e-47dd-a78c-224cbab21a85', 'status': 'completed', 'code': 200} Jun 17 11:03:20.944031 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a72cae5a-7be9-4c88-ba96-59e4f5a601d8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:21.052122 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a72cae5a-7be9-4c88-ba96-59e4f5a601d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:21.056604 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-df6186a3-efdb-4aa8-ba80-0064115998c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:21.097651 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-a72cae5a-7be9-4c88-ba96-59e4f5a601d8 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=a02f53f1be7b4c7a999dba5cc35e797e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3963230 Jun 17 11:03:21.099592 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a72cae5a-7be9-4c88-ba96-59e4f5a601d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ad12cae-25a2-4af1-8c58-96fb4d6d3d48,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:21.101508 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37088) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:21.105990 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a72cae5a-7be9-4c88-ba96-59e4f5a601d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:21.164471 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c3b33a6e-63d2-46aa-a056-5ecd7231e63d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:21.201931 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c3b33a6e-63d2-46aa-a056-5ecd7231e63d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:21.246969 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4cd6852-8b2a-432e-8250-f09b9e4ce504 req-ca89be2a-8a63-4d40-9ec8-77e5e898cc24 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:21.256731 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f4cd6852-8b2a-432e-8250-f09b9e4ce504 req-ca89be2a-8a63-4d40-9ec8-77e5e898cc24 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.1002183 Jun 17 11:03:21.296711 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f4cd6852-8b2a-432e-8250-f09b9e4ce504 req-e7d51d25-dfbb-45d9-85dc-5cdef27ae1ec tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391989 Jun 17 11:03:21.351523 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-06312d12-b50a-48be-8635-3397c9e4fa40 req-854c5b9a-1353-4c11-89ab-ba9cc39927ab tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=d24ac987-0f9c-4315-a0ec-68765090caf9 HTTP/1.1" status: 200 len: 210 time: 0.0292928 Jun 17 11:03:21.365249 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c3b33a6e-63d2-46aa-a056-5ecd7231e63d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:21.367918 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c3b33a6e-63d2-46aa-a056-5ecd7231e63d admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:21.369017 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-c3b33a6e-63d2-46aa-a056-5ecd7231e63d admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/1ad12cae-25a2-4af1-8c58-96fb4d6d3d48 HTTP/1.1" status: 204 len: 168 time: 0.2658947 Jun 17 11:03:21.369986 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-afcbd5cc-9d8e-4b95-8616-fdd5dcc73850 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:21.381323 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3b33a6e-63d2-46aa-a056-5ecd7231e63d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ad12cae-25a2-4af1-8c58-96fb4d6d3d48,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:21.384194 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c3b33a6e-63d2-46aa-a056-5ecd7231e63d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:22.507458 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3271ef20-47c6-489e-8304-a701f7c29500 req-90952e97-bb49-421a-8390-5c1a512b76fc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:22.518518 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37124) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:22.520280 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3271ef20-47c6-489e-8304-a701f7c29500 req-90952e97-bb49-421a-8390-5c1a512b76fc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0910633 Jun 17 11:03:22.557177 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3271ef20-47c6-489e-8304-a701f7c29500 req-93f76c93-8a44-41f5-8eab-d5d1e4dd21c6 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358002 Jun 17 11:03:22.631884 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1993744618-network', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:03:22.765622 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Made reservation on behalf of ed69cf6aa40941c48c25effb0c1af8fc for: {'network': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:03:22.770471 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:22.783908 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:22.900997 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:22.999172 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.003579 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-7d5fb13e-6723-49fa-85d8-2dbfbfa05e7d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:23.020803 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=110214) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 11:03:23.034046 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d13c205a-f6de-4b53-abc9-1484c3d728be,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:23.039115 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:23.040193 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.040530 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.segments_db [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Added segment d3fb73d8-1b81-4c52-a6b6-adfd6cce7334 of type vlan for network aeced3ed-7670-4043-a385-87de6f75150b Jun 17 11:03:23.079638 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.120240 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df520050-28a5-49f7-896e-8698835bbafc req-2364c84c-b748-4d88-94e5-8b31f8a0be73 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:23.125390 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-df520050-28a5-49f7-896e-8698835bbafc req-2364c84c-b748-4d88-94e5-8b31f8a0be73 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 945 time: 0.0742600 Jun 17 11:03:23.162809 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-df520050-28a5-49f7-896e-8698835bbafc req-c3ecd3c4-1a50-4a03-965b-60d4d6938d36 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347319 Jun 17 11:03:23.164815 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.166456 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:23.167074 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.171402 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-796d02eb-2f87-4366-b89d-a7720e7b81d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:23.239307 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Pushing event updated for resources: {'Network': ['ID=aeced3ed-7670-4043-a385-87de6f75150b,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:23.242408 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:23.254281 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network aeced3ed-7670-4043-a385-87de6f75150b details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 11:03:23.259874 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.7372696 Jun 17 11:03:23.260206 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37138) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:23.265369 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Request body: {'subnet': {'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1993744618-subnet', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'ip_version': 4}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:03:23.353865 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f66121a8-9a6c-41a7-aec8-df647fc30f34 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.356396 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Made reservation on behalf of ed69cf6aa40941c48c25effb0c1af8fc for: {'subnet': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:03:23.363111 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5636039'] for subnet, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.559188 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.576107 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5898957', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5636053'] for subnet, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.578301 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:23.630354 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Pushing event updated for resources: {'Subnet': ['ID=5d332463-1c62-46e2-a7e3-4b587a2e5f1e,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:23.632988 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:23.640096 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Checking segment: {'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:03:23.640444 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Network hostable DHCP agents. Network: aeced3ed-7670-4043-a385-87de6f75150b, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110215) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 11:03:23.696579 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Network aeced3ed-7670-4043-a385-87de6f75150b is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110215) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 11:03:23.770865 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, aeced3ed-7670-4043-a385-87de6f75150b) {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:23.775367 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:23.778944 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.780367 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3df62942-34b1-422c-a2aa-fa1b8b9ae7ca None None] Network aeced3ed-7670-4043-a385-87de6f75150b requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:03:23.861440 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.5960879 Jun 17 11:03:23.861440 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37144) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:23.866293 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:03:23.942673 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8358582', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1816'] for router, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.943847 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8357919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8287158', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-8346348', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2019'] for router, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:23.949001 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5498e9f9-7e24-5c53-b771-9493a76e3e58-aeced3ed-7670-4043-a385-87de6f75150b', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'fixed_ips': [{'subnet_id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e'}]}} from dv-cinder-773870-6-iscsi. {{(pid=110216) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Jun 17 11:03:23.952899 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.013606 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.086142 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device ab14f0f0-986e-47dd-a78c-224cbab21a85 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:03:24.117359 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: ab14f0f0-986e-47dd-a78c-224cbab21a85 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:03:24.117597 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device ab14f0f0-986e-47dd-a78c-224cbab21a85 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:03:24.123078 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.db_base_plugin_common [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Allocated IP 172.20.0.2 (aeced3ed-7670-4043-a385-87de6f75150b/5d332463-1c62-46e2-a7e3-4b587a2e5f1e/73e98b86-7c73-4167-b4a8-feb4cf8eeaba) {{(pid=110216) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:03:24.218035 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8287140', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8358552', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2037'] for router, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.283749 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Notify callbacks [] for port, precommit_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.292909 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Transition to ACTIVE for port object 73e98b86-7c73-4167-b4a8-feb4cf8eeaba will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:24.309515 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Transition to ACTIVE for port object 73e98b86-7c73-4167-b4a8-feb4cf8eeaba will not be triggered until provisioned by entity DHCP. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:24.365784 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592c8ee2-acee-4853-89ad-2caa0338186f req-ee87c95f-c212-46e1-93d6-1db0b1c13567 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:24.367485 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-592c8ee2-acee-4853-89ad-2caa0338186f req-ee87c95f-c212-46e1-93d6-1db0b1c13567 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 945 time: 0.0647402 Jun 17 11:03:24.416312 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-592c8ee2-acee-4853-89ad-2caa0338186f req-4852fe19-cf9f-423a-8798-71a3048f72a7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416791 Jun 17 11:03:24.422662 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.424722 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:24.455141 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.473038 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Network aeced3ed-7670-4043-a385-87de6f75150b is already hosted by enough agents. {{(pid=110216) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:03:24.476875 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.base_scheduler [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Resources bound (agent type, host, resource id): {{(pid=110216) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:24.478897 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Pushing event updated for resources: {'Port': ['ID=73e98b86-7c73-4167-b4a8-feb4cf8eeaba,revision_number=1']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:24.480865 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Received port after_create {{(pid=110216) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:03:24.482889 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:24.525881 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.543175 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Attempting to bind port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:03:24.543555 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Attempting to bind port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:03:24.543922 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Attempting to bind port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba on network aeced3ed-7670-4043-a385-87de6f75150b {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:03:24.544503 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.548795 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 3, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:03:24.549175 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Checking segment: {'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:03:24.549583 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.549981 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Bound using segment: {'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:03:24.550450 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Bound port: 73e98b86-7c73-4167-b4a8-feb4cf8eeaba, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:03:24.551380 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.612399 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] For port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:03:24.615468 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] For port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=73e98b86-7c73-4167-b4a8-feb4cf8eeaba,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:03:24.648294 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Allocated IP 172.27.3.151 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/2c924c70-c971-4a36-8d58-1335920ceb42) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:03:24.674171 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.677127 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:24.730532 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Pushing event updated for resources: {'Port': ['ID=73e98b86-7c73-4167-b4a8-feb4cf8eeaba,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:24.742104 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:24.756655 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.875031 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:24.877635 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:24.928432 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:03:24.932258 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Pushing event updated for resources: {'Port': ['ID=2c924c70-c971-4a36-8d58-1335920ceb42,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:24.935061 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:24.938918 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:24.938918 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:03:25.294917 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:25.406436 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1406c5fe-17d8-4996-9d4b-18f107b37103 req-99ba6859-f75b-4e94-8aee-51b877945aab tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:25.407971 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1406c5fe-17d8-4996-9d4b-18f107b37103 req-99ba6859-f75b-4e94-8aee-51b877945aab tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 945 time: 0.2122867 Jun 17 11:03:25.657133 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec7fa47a-53fe-45dc-ba0e-50e9d2671a21 req-9bdb9cf8-24e7-4edc-95a8-b57e50070864 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:25.658789 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ec7fa47a-53fe-45dc-ba0e-50e9d2671a21 req-9bdb9cf8-24e7-4edc-95a8-b57e50070864 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 945 time: 0.0833530 Jun 17 11:03:25.727568 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ec7fa47a-53fe-45dc-ba0e-50e9d2671a21 req-3228c070-c6e6-4706-a303-40129c039ace tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614629 Jun 17 11:03:25.748788 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72f5c33d-0498-4b69-8f04-a76247592a74 None None] Network aeced3ed-7670-4043-a385-87de6f75150b requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:03:25.856276 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8358543', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8287186'] for router, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:25.942973 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af5730f-ea96-4fd4-a434-9395010ee5d1 req-1a4efbb3-dcfb-49f1-83c5-3c86a58898f4 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:25.944253 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1af5730f-ea96-4fd4-a434-9395010ee5d1 req-1a4efbb3-dcfb-49f1-83c5-3c86a58898f4 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.4746389 Jun 17 11:03:25.994880 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-1406c5fe-17d8-4996-9d4b-18f107b37103 req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Deleting port b9d0052c-f650-4dae-8e30-09f806a67cfb {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:03:25.995256 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-1406c5fe-17d8-4996-9d4b-18f107b37103 req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:26.015693 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-dc9a7a7d-7c80-4442-b642-94f6fec76c32 None None] Provisioning for port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:26.034822 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1af5730f-ea96-4fd4-a434-9395010ee5d1 req-6f1a68bc-8338-4eb2-8772-ef6fe42eceb2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795803 Jun 17 11:03:26.157008 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-1406c5fe-17d8-4996-9d4b-18f107b37103 req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] For port b9d0052c-f650-4dae-8e30-09f806a67cfb, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=b9d0052c-f650-4dae-8e30-09f806a67cfb,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:26.160925 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-1406c5fe-17d8-4996-9d4b-18f107b37103 req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:26.176879 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 73e98b86-7c73-4167-b4a8-feb4cf8eeaba up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:26.279908 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-1406c5fe-17d8-4996-9d4b-18f107b37103 req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Calling delete_port for b9d0052c-f650-4dae-8e30-09f806a67cfb owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:03:26.285920 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f is scheduled to L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 with binding_index 1 {{(pid=110215) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} Jun 17 11:03:26.324816 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:26.328789 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:26.329172 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:26.375882 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-4ab9e2b9-dc27-423c-abf3-82288ae72f73 None None] Provisioning complete for port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:26.376187 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-4ab9e2b9-dc27-423c-abf3-82288ae72f73 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:26.449229 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:26.489946 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:03:26.505954 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Sync routers for ids ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:03:26.512359 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=73e98b86-7c73-4167-b4a8-feb4cf8eeaba,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:26.519256 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Routers {'7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:03:26.519751 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-4ab9e2b9-dc27-423c-abf3-82288ae72f73 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:26.519933 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:03:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:26.572948 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:26.575484 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-8d826362-6782-4e30-a195-58fc99e11d60 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:26.599976 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-1406c5fe-17d8-4996-9d4b-18f107b37103 req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:26.601680 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Notify callbacks [] for router, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:26.603023 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] 10.222.0.41 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.7419930 Jun 17 11:03:26.605914 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:26.606945 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37184) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:26.625615 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Set router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:03:26.637905 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Pushing event deleted for resources: {'Port': ['ID=b9d0052c-f650-4dae-8e30-09f806a67cfb,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:26.641324 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:26.647244 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5df2bc70-d7c4-4355-b3d7-81d2732dfd9d', 'b9d0052c-f650-4dae-8e30-09f806a67cfb'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:03:26.726622 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-1406c5fe-17d8-4996-9d4b-18f107b37103 req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] No DVR routers for this DVR port b9d0052c-f650-4dae-8e30-09f806a67cfb on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:03:26.728972 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-1406c5fe-17d8-4996-9d4b-18f107b37103 req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:26.733630 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1406c5fe-17d8-4996-9d4b-18f107b37103 req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "DELETE /v2.0/ports/b9d0052c-f650-4dae-8e30-09f806a67cfb HTTP/1.1" status: 204 len: 173 time: 1.2960429 Jun 17 11:03:26.734755 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '994a1663-51bc-401a-969e-e74abbe386f5', 'name': 'network-vif-deleted', 'tag': 'b9d0052c-f650-4dae-8e30-09f806a67cfb'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:03:26.751713 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf5ed73c-bab6-42f2-9796-bb3e01332630" -d '{"events": [{"server_uuid": "994a1663-51bc-401a-969e-e74abbe386f5", "name": "network-vif-deleted", "tag": "b9d0052c-f650-4dae-8e30-09f806a67cfb"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:03:26.772652 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.db.api [None req-4ab9e2b9-dc27-423c-abf3-82288ae72f73 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=110216) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Jun 17 11:03:26.773224 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_db.api [None req-4ab9e2b9-dc27-423c-abf3-82288ae72f73 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Jun 17 11:03:26.774508 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=73e98b86-7c73-4167-b4a8-feb4cf8eeaba,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:26.790225 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:26.797180 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:03:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49423b55-5e11-4e32-ae4d-0d81ab047b6d x-openstack-request-id: req-49423b55-5e11-4e32-ae4d-0d81ab047b6d {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:03:26.798568 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "994a1663-51bc-401a-969e-e74abbe386f5", "name": "network-vif-deleted", "tag": "b9d0052c-f650-4dae-8e30-09f806a67cfb", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:03:26.799054 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-49423b55-5e11-4e32-ae4d-0d81ab047b6d {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:03:26.799688 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '994a1663-51bc-401a-969e-e74abbe386f5', 'name': 'network-vif-deleted', 'tag': 'b9d0052c-f650-4dae-8e30-09f806a67cfb', 'status': 'completed', 'code': 200} Jun 17 11:03:26.862597 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:26.911367 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:25Z', 'revision_number': 3, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:26.958935 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Checking router: 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:03:26.962747 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-61e01ecc-e20f-4ace-af68-32a05b7578ef req-f4422bed-1b8e-4149-aeb5-01b30c57c6f4 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=994a1663-51bc-401a-969e-e74abbe386f5 HTTP/1.1" status: 200 len: 210 time: 0.0653787 Jun 17 11:03:26.963420 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Updating router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f port 2c924c70-c971-4a36-8d58-1335920ceb42 binding host dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:03:27.011009 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:27.215139 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:27.308691 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Notify callbacks [] for port, precommit_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:27.320347 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.provisioning_blocks [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Transition to ACTIVE for port object 2c924c70-c971-4a36-8d58-1335920ceb42 will not be triggered until provisioned by entity L2. {{(pid=110218) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:27.370535 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:27.372892 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-67ed3eb6-504d-4578-b57c-6bf747a437f2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:27.400793 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Allocated IP 172.20.0.1 (aeced3ed-7670-4043-a385-87de6f75150b/5d332463-1c62-46e2-a7e3-4b587a2e5f1e/fc90a0fd-7ca9-4a92-a265-28ce1dd9160f) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:03:27.429635 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Pushing event updated for resources: {'Port': ['ID=2c924c70-c971-4a36-8d58-1335920ceb42,revision_number=2']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:27.431834 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Attempting to bind port 2c924c70-c971-4a36-8d58-1335920ceb42 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:03:27.432192 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Attempting to bind port 2c924c70-c971-4a36-8d58-1335920ceb42 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:03:27.432549 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Attempting to bind port 2c924c70-c971-4a36-8d58-1335920ceb42 on network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:03:27.443005 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 3, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:03:27.443549 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Checking segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110218) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:03:27.444039 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:27.444544 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Bound using segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:03:27.445121 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Bound port: 2c924c70-c971-4a36-8d58-1335920ceb42, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:03:27.445577 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:27.449242 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.449705 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.450134 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.450646 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.451136 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.451549 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.452339 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.452484 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.452902 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.453402 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.453845 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.454311 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:27.484859 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:27.505933 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:27.518532 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] For port 2c924c70-c971-4a36-8d58-1335920ceb42, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110218) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:03:27.522179 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] For port 2c924c70-c971-4a36-8d58-1335920ceb42, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=2c924c70-c971-4a36-8d58-1335920ceb42,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110218) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:03:27.525243 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.provisioning_blocks [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Transition to ACTIVE for port object fc90a0fd-7ca9-4a92-a265-28ce1dd9160f will not be triggered until provisioned by entity DHCP. {{(pid=110214) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:27.611168 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:27.614354 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:27.662709 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:27.668149 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:27.683496 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Routers {'7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:03:27.684156 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:03:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:27.704518 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Network aeced3ed-7670-4043-a385-87de6f75150b is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:03:27.707908 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:27.720474 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:03:27.737687 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Pushing event updated for resources: {'Port': ['ID=fc90a0fd-7ca9-4a92-a265-28ce1dd9160f,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:27.765900 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8290659'] for router_interface, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:27.774900 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:27.857316 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Pushing event updated for resources: {'Port': ['ID=2c924c70-c971-4a36-8d58-1335920ceb42,revision_number=3']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:27.864881 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:27.928129 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] Set router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:03:28.002523 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:28.142633 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-b88ded28-36cd-420c-accc-34f28aa37d46 None None] Provisioning for port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:28.147192 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-b88ded28-36cd-420c-accc-34f28aa37d46 None None] Provisioning complete for port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:28.147876 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-b88ded28-36cd-420c-accc-34f28aa37d46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:28.209077 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:25Z', 'revision_number': 3, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:28.209459 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 73e98b86-7c73-4167-b4a8-feb4cf8eeaba up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:28.240835 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dc81452-5a5d-4960-a7f1-d6b5b9476cd4 None None] The sync data for ids ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'] in dv-cinder-773870-6-iscsi is: [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:25Z', 'revision_number': 3, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:03:28.253891 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-b88ded28-36cd-420c-accc-34f28aa37d46 None None] Port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:03:28.270248 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:28.277106 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:28.277498 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:28.348457 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:28.351941 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:28.427453 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Pushing event updated for resources: {'Port': ['ID=fc90a0fd-7ca9-4a92-a265-28ce1dd9160f,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:28.429511 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7899558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8290591'] for router_interface, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:28.431628 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:28.559126 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Network aeced3ed-7670-4043-a385-87de6f75150b is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:03:28.560601 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:28.696315 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:03:28.778682 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-57a8691d-87d7-4665-bc88-5b7d64c8158a None None] Provisioning complete for port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:28.779112 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-57a8691d-87d7-4665-bc88-5b7d64c8158a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:28.809334 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:03:28.815763 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] 10.222.0.41 "PUT /v2.0/routers/7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2077289 Jun 17 11:03:28.821338 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-57a8691d-87d7-4665-bc88-5b7d64c8158a None None] Port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:03:29.050310 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:03:29.464640 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37236) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:29.469750 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-428147393-network', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:03:29.553400 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Made reservation on behalf of 513dfbb39109406bb7e4ae289b99ad98 for: {'network': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:03:29.555903 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:29.565255 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:29.658396 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:29.741986 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:29.745272 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-cf3e64b9-d285-4925-9d89-a4f71e1c0cfe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:29.768940 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=110214) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 11:03:29.779544 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=722c2ca3-3f5b-4fe9-a9f3-0dcd4755001d,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:29.784289 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:29.785632 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:29.785986 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.segments_db [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Added segment a1ea3154-a16f-407e-87a0-2b5b223e448c of type vlan for network d8beeb1f-3611-4a57-a06b-8027d5a36842 Jun 17 11:03:29.789335 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Sync routers for ids ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:03:29.812317 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Routers {'7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:03:29.812959 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:03:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:29.841756 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:29.922316 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Set router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:03:29.939020 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:29.939020 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:29.939020 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:29.940496 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:30.020201 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Pushing event updated for resources: {'Network': ['ID=d8beeb1f-3611-4a57-a06b-8027d5a36842,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:30.023365 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:30.043712 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37244) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:30.044214 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.5780704 Jun 17 11:03:30.051453 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Request body: {'subnet': {'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-428147393-subnet', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'ip_version': 4}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:03:30.114489 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network d8beeb1f-3611-4a57-a06b-8027d5a36842 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 11:03:30.124553 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device b9d0052c-f650-4dae-8e30-09f806a67cfb no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:03:30.167822 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 2c924c70-c971-4a36-8d58-1335920ceb42 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:30.173374 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: b9d0052c-f650-4dae-8e30-09f806a67cfb {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:03:30.173725 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device b9d0052c-f650-4dae-8e30-09f806a67cfb not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:03:30.177573 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Made reservation on behalf of 513dfbb39109406bb7e4ae289b99ad98 for: {'subnet': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:03:30.179909 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5636039'] for subnet, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:30.286295 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ec0714e-f864-4e14-a467-ae43b9b30277 req-77294cfb-e77d-4ce5-846d-5765bf00d15c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:30.287853 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5ec0714e-f864-4e14-a467-ae43b9b30277 req-77294cfb-e77d-4ce5-846d-5765bf00d15c tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.1465936 Jun 17 11:03:30.307051 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 4, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'fc90a0fd-7ca9-4a92-a265-28ce1dd9160f', 'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'mac_address': 'fa:16:3e:88:9a:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:27Z', 'updated_at': '2021-06-17T11:03:28Z', 'revision_number': 2, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'subnets': [{'id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:30.339397 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Checking router: 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:03:30.343657 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Updating router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f binding host dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:03:30.365664 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5ec0714e-f864-4e14-a467-ae43b9b30277 req-325fbf4f-dcf0-47cb-a180-397a9ba9c37d tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654328 Jun 17 11:03:30.366981 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 2c924c70-c971-4a36-8d58-1335920ceb42 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:30.370580 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 2c924c70-c971-4a36-8d58-1335920ceb42 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:30.372774 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:30.411996 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:30.468079 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5898957', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5636053'] for subnet, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:30.471428 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:30.524403 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Pushing event updated for resources: {'Subnet': ['ID=8a8d9b36-b457-42ac-b365-dc16ef24b559,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:30.528017 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:30.534817 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Checking segment: {'id': 'a1ea3154-a16f-407e-87a0-2b5b223e448c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:03:30.535870 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Network hostable DHCP agents. Network: d8beeb1f-3611-4a57-a06b-8027d5a36842, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110215) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 11:03:30.549391 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:30.581099 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 2c924c70-c971-4a36-8d58-1335920ceb42, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=2c924c70-c971-4a36-8d58-1335920ceb42,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:30.622072 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Network d8beeb1f-3611-4a57-a06b-8027d5a36842 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110215) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 11:03:30.654448 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:30.658586 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6d64879c-1103-4910-a230-1ee887b6c63d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:30.708228 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, d8beeb1f-3611-4a57-a06b-8027d5a36842) {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:30.712741 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:30.713372 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:30.729108 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5425372-45f0-455b-86c0-a8e253a4d5d0 None None] Network d8beeb1f-3611-4a57-a06b-8027d5a36842 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:03:30.761656 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=2c924c70-c971-4a36-8d58-1335920ceb42,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:30.766946 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:30.793023 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Notify callbacks [] for port, precommit_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:30.817233 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-411e2453-f6e0-4ccc-8efe-cd3e0ae2296e admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.7716746 Jun 17 11:03:30.828832 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37250) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:30.835465 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-428147393-router', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:03:30.836688 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Transition to ACTIVE for port object fc90a0fd-7ca9-4a92-a265-28ce1dd9160f will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:30.893759 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:30.897156 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-091ceff6-583e-43df-9401-604e4b788d87 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:30.907790 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8358582', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1816'] for router, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:30.908846 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8357919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8287158', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-8346348', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2019'] for router, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:30.960200 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:31.100348 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5498e9f9-7e24-5c53-b771-9493a76e3e58-d8beeb1f-3611-4a57-a06b-8027d5a36842', 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'fixed_ips': [{'subnet_id': '8a8d9b36-b457-42ac-b365-dc16ef24b559'}]}} from dv-cinder-773870-6-iscsi. {{(pid=110216) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Jun 17 11:03:31.101203 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:31.117335 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276011e1-a940-4234-9c70-7451fd3dd31b None None] Pushing event updated for resources: {'Port': ['ID=fc90a0fd-7ca9-4a92-a265-28ce1dd9160f,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:31.122338 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-276011e1-a940-4234-9c70-7451fd3dd31b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:31.258817 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Attempting to bind port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:03:31.259154 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Attempting to bind port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:03:31.259522 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Attempting to bind port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f on network aeced3ed-7670-4043-a385-87de6f75150b {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:03:31.289424 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 3, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:03:31.289861 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Checking segment: {'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:03:31.290227 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:31.290625 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Bound using segment: {'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:03:31.291176 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Bound port: fc90a0fd-7ca9-4a92-a265-28ce1dd9160f, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:03:31.291540 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:31.347400 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.db_base_plugin_common [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Allocated IP 172.20.0.2 (d8beeb1f-3611-4a57-a06b-8027d5a36842/8a8d9b36-b457-42ac-b365-dc16ef24b559/9a5c3d03-1d5b-4666-9ca6-b1bd433f5866) {{(pid=110216) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:03:31.380768 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8287140', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8358552', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2037'] for router, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:31.398056 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] For port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:03:31.422287 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] For port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=fc90a0fd-7ca9-4a92-a265-28ce1dd9160f,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:03:31.476155 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:31.480198 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:31.581162 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Notify callbacks [] for port, precommit_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:31.589462 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276011e1-a940-4234-9c70-7451fd3dd31b None None] Pushing event updated for resources: {'Port': ['ID=fc90a0fd-7ca9-4a92-a265-28ce1dd9160f,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:31.594630 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Routers {'7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:03:31.595391 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:03:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:31.599365 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-276011e1-a940-4234-9c70-7451fd3dd31b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:31.600485 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Transition to ACTIVE for port object 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:31.600751 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f84315eb-e273-476c-a681-86b430084116 req-48f4eb3f-e885-4e22-8b2b-68d9f6e80363 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:31.602268 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f84315eb-e273-476c-a681-86b430084116 req-48f4eb3f-e885-4e22-8b2b-68d9f6e80363 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0884521 Jun 17 11:03:31.686355 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Transition to ACTIVE for port object 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 will not be triggered until provisioned by entity DHCP. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:31.729980 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f84315eb-e273-476c-a681-86b430084116 req-79671fba-53d4-4983-8694-6301a8d52c6e tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0921497 Jun 17 11:03:31.735561 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] Set router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:03:31.745548 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:31.765565 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:31.779237 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:31.783815 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-b8b3ecc6-0ef7-4217-b4f2-6cde410fcfa9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:31.828879 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Network d8beeb1f-3611-4a57-a06b-8027d5a36842 is already hosted by enough agents. {{(pid=110216) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:03:31.859909 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.base_scheduler [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Resources bound (agent type, host, resource id): {{(pid=110216) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:31.867859 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Received port after_create {{(pid=110216) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:03:31.873728 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Allocated IP 172.27.3.238 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/78b15da2-1d10-42eb-927c-9b229a7351ae) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:03:31.888872 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Pushing event updated for resources: {'Port': ['ID=9a5c3d03-1d5b-4666-9ca6-b1bd433f5866,revision_number=1']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:31.918327 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:31.977653 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:31.992222 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Attempting to bind port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:03:31.992512 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Attempting to bind port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': 'a1ea3154-a16f-407e-87a0-2b5b223e448c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:03:31.992927 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Attempting to bind port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 on network d8beeb1f-3611-4a57-a06b-8027d5a36842 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:03:32.006495 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 3, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:03:32.006909 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Checking segment: {'id': 'a1ea3154-a16f-407e-87a0-2b5b223e448c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:03:32.007327 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:32.007730 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Bound using segment: {'id': 'a1ea3154-a16f-407e-87a0-2b5b223e448c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:03:32.008216 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Bound port: 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a1ea3154-a16f-407e-87a0-2b5b223e448c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:03:32.008597 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:32.066290 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 2c924c70-c971-4a36-8d58-1335920ceb42 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:32.109247 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:32.111466 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-07c6710e-b67c-4d5f-837f-d04704bdcc79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:32.147906 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] For port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:03:32.151365 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:03:32.152254 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] For port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=9a5c3d03-1d5b-4666-9ca6-b1bd433f5866,segment=NetworkSegment(a1ea3154-a16f-407e-87a0-2b5b223e448c),segment_id=a1ea3154-a16f-407e-87a0-2b5b223e448c)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:03:32.159474 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:32.161195 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 4, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'fc90a0fd-7ca9-4a92-a265-28ce1dd9160f', 'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'mac_address': 'fa:16:3e:88:9a:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:27Z', 'updated_at': '2021-06-17T11:03:31Z', 'revision_number': 4, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'subnets': [{'id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:32.162738 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:03:32.164964 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 2c924c70-c971-4a36-8d58-1335920ceb42 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:32.164964 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:32.165232 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Pushing event updated for resources: {'Port': ['ID=78b15da2-1d10-42eb-927c-9b229a7351ae,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:32.173203 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:32.190098 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa680305-6658-4187-a6f9-4093210e5a64 None None] The sync data for ids ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'] in dv-cinder-773870-6-iscsi is: [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 4, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'fc90a0fd-7ca9-4a92-a265-28ce1dd9160f', 'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'mac_address': 'fa:16:3e:88:9a:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:27Z', 'updated_at': '2021-06-17T11:03:31Z', 'revision_number': 4, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'subnets': [{'id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:03:32.264781 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:32.272625 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:32.366284 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Pushing event updated for resources: {'Port': ['ID=9a5c3d03-1d5b-4666-9ca6-b1bd433f5866,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:32.369742 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:32.496390 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49846c0f-5e84-4918-ae07-4fe41ab94277 req-14772e10-81b2-4afc-97ec-241397696c91 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:32.499811 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-49846c0f-5e84-4918-ae07-4fe41ab94277 req-14772e10-81b2-4afc-97ec-241397696c91 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.1037569 Jun 17 11:03:32.597446 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:32.643182 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-49846c0f-5e84-4918-ae07-4fe41ab94277 req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Deleting port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:03:32.643783 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-49846c0f-5e84-4918-ae07-4fe41ab94277 req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:32.756309 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-49846c0f-5e84-4918-ae07-4fe41ab94277 req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] For port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d,segment=NetworkSegment(f32f5ed9-539a-457e-8330-d3310fcdf7eb),segment_id=f32f5ed9-539a-457e-8330-d3310fcdf7eb)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:32.756816 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-49846c0f-5e84-4918-ae07-4fe41ab94277 req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:32.831633 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-49846c0f-5e84-4918-ae07-4fe41ab94277 req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Calling delete_port for 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:03:32.831969 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8358543', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8287186'] for router, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:32.971997 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c3aee5b-0570-44a5-9806-d356cec03917 req-913088b2-4f2e-468b-b669-82770b6832e0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:32.973563 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0c3aee5b-0570-44a5-9806-d356cec03917 req-913088b2-4f2e-468b-b669-82770b6832e0 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 945 time: 0.0981627 Jun 17 11:03:33.033082 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Router 09c83440-160f-4872-866e-39bee65fe6ab is scheduled to L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 with binding_index 1 {{(pid=110214) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} Jun 17 11:03:33.046208 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0c3aee5b-0570-44a5-9806-d356cec03917 req-cc3d74de-b546-4db8-b303-ee3f43ad6b68 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/security-groups?id=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662370 Jun 17 11:03:33.090438 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-49846c0f-5e84-4918-ae07-4fe41ab94277 req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:33.102562 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7cca5c92-8b28-4b62-9c07-be8f653333da tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:33.104842 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5df2bc70-d7c4-4355-b3d7-81d2732dfd9d'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:03:33.131414 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Pushing event deleted for resources: {'Port': ['ID=5df2bc70-d7c4-4355-b3d7-81d2732dfd9d,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:33.137016 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:33.163419 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:03:33.174209 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Sync routers for ids ['09c83440-160f-4872-866e-39bee65fe6ab'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:03:33.190951 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-49846c0f-5e84-4918-ae07-4fe41ab94277 req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] No DVR routers for this DVR port 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:03:33.191133 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Routers {'09c83440-160f-4872-866e-39bee65fe6ab'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:03:33.191773 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:03:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['09c83440-160f-4872-866e-39bee65fe6ab'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:33.194930 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-49846c0f-5e84-4918-ae07-4fe41ab94277 req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:33.197162 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-49846c0f-5e84-4918-ae07-4fe41ab94277 req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.25 "DELETE /v2.0/ports/5df2bc70-d7c4-4355-b3d7-81d2732dfd9d HTTP/1.1" status: 204 len: 173 time: 0.6892986 Jun 17 11:03:33.198572 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e6129b0-030d-4abe-90f0-dea76231bc08', 'name': 'network-vif-deleted', 'tag': '5df2bc70-d7c4-4355-b3d7-81d2732dfd9d'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:03:33.200701 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8ce722e-48c4-444b-bacd-dffed3fa1ca4" -d '{"events": [{"server_uuid": "6e6129b0-030d-4abe-90f0-dea76231bc08", "name": "network-vif-deleted", "tag": "5df2bc70-d7c4-4355-b3d7-81d2732dfd9d"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:03:33.250818 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Notify callbacks [] for router, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:33.252407 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] 10.222.0.41 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.4215908 Jun 17 11:03:33.255684 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37274) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:33.304447 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:03:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca86d7db-8f71-4479-9d34-d351bb3df396 x-openstack-request-id: req-ca86d7db-8f71-4479-9d34-d351bb3df396 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:03:33.304902 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6e6129b0-030d-4abe-90f0-dea76231bc08", "name": "network-vif-deleted", "tag": "5df2bc70-d7c4-4355-b3d7-81d2732dfd9d", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:03:33.305287 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-ca86d7db-8f71-4479-9d34-d351bb3df396 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:03:33.306114 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6e6129b0-030d-4abe-90f0-dea76231bc08', 'name': 'network-vif-deleted', 'tag': '5df2bc70-d7c4-4355-b3d7-81d2732dfd9d', 'status': 'completed', 'code': 200} Jun 17 11:03:33.347414 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Set router 09c83440-160f-4872-866e-39bee65fe6ab gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:03:33.629800 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9dc719f7-7aaa-4427-88ce-e6b43f6a2b8b None None] Network d8beeb1f-3611-4a57-a06b-8027d5a36842 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:03:33.643043 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09c83440-160f-4872-866e-39bee65fe6ab', 'name': 'tempest-TestMinimumBasicScenario-428147393-router', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:30Z', 'updated_at': '2021-06-17T11:03:32Z', 'revision_number': 3, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'gw_port': {'id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:a7:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09c83440-160f-4872-866e-39bee65fe6ab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:31Z', 'updated_at': '2021-06-17T11:03:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:33.681391 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Checking router: 09c83440-160f-4872-866e-39bee65fe6ab for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:03:33.681809 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Updating router 09c83440-160f-4872-866e-39bee65fe6ab port 78b15da2-1d10-42eb-927c-9b229a7351ae binding host dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:03:33.725935 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:33.802331 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-9f4a2f02-8fc6-4a79-a314-7dfa46ce8e3a None None] Provisioning for port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:33.831314 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:33.998453 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Allocated IP 172.20.0.1 (d8beeb1f-3611-4a57-a06b-8027d5a36842/8a8d9b36-b457-42ac-b365-dc16ef24b559/68867abb-4eea-4548-9fa0-32ed4c61ef87) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:03:34.017173 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Notify callbacks [] for port, precommit_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.032861 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.provisioning_blocks [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Transition to ACTIVE for port object 78b15da2-1d10-42eb-927c-9b229a7351ae will not be triggered until provisioned by entity L2. {{(pid=110218) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:34.107708 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.112305 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-67ed3eb6-504d-4578-b57c-6bf747a437f2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:34.134734 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.164344 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.provisioning_blocks [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Transition to ACTIVE for port object 68867abb-4eea-4548-9fa0-32ed4c61ef87 will not be triggered until provisioned by entity DHCP. {{(pid=110214) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:34.166539 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device fc90a0fd-7ca9-4a92-a265-28ce1dd9160f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:34.170892 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Attempting to bind port 78b15da2-1d10-42eb-927c-9b229a7351ae on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:03:34.171274 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Attempting to bind port 78b15da2-1d10-42eb-927c-9b229a7351ae by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:03:34.171915 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Attempting to bind port 78b15da2-1d10-42eb-927c-9b229a7351ae on network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:03:34.173933 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8602912c-9186-4a0b-8653-b0f3e5cdec29 None None] Pushing event updated for resources: {'Port': ['ID=78b15da2-1d10-42eb-927c-9b229a7351ae,revision_number=2']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:34.185610 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-8602912c-9186-4a0b-8653-b0f3e5cdec29 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:34.201821 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 3, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:03:34.213905 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Checking segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110218) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:03:34.214380 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.218577 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Bound using segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:03:34.218577 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Bound port: 78b15da2-1d10-42eb-927c-9b229a7351ae, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:03:34.218577 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.270956 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] For port 78b15da2-1d10-42eb-927c-9b229a7351ae, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110218) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:03:34.274453 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] For port 78b15da2-1d10-42eb-927c-9b229a7351ae, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=78b15da2-1d10-42eb-927c-9b229a7351ae,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110218) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:03:34.276212 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-88cbbf01-47b4-4327-a5d5-b0b9c252ccf4 req-3721eef1-c489-4c59-add0-3eb6c59eaa2a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] 10.222.0.41 "GET /v2.0/ports?device_id=6e6129b0-030d-4abe-90f0-dea76231bc08 HTTP/1.1" status: 200 len: 210 time: 0.0287013 Jun 17 11:03:34.366185 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:34.368079 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.370420 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:34.371023 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.372862 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-664fa5b0-ec55-47af-bd76-611433630a9f tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:34.394419 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.399648 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-bec2c3df-8c0d-467f-bc02-95b6863269f8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:34.423762 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Pushing event updated for resources: {'Port': ['ID=68867abb-4eea-4548-9fa0-32ed4c61ef87,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:34.429874 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:34.438362 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Network d8beeb1f-3611-4a57-a06b-8027d5a36842 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:03:34.439789 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:34.443567 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:03:34.506449 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8290659'] for router_interface, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.524313 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.528536 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Routers {'09c83440-160f-4872-866e-39bee65fe6ab'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:03:34.529364 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:03:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['09c83440-160f-4872-866e-39bee65fe6ab'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:34.573867 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8602912c-9186-4a0b-8653-b0f3e5cdec29 None None] Pushing event updated for resources: {'Port': ['ID=78b15da2-1d10-42eb-927c-9b229a7351ae,revision_number=3']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:34.577787 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-8602912c-9186-4a0b-8653-b0f3e5cdec29 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:34.593989 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=fc90a0fd-7ca9-4a92-a265-28ce1dd9160f,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:34.679502 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.680407 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:34.682560 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:34.707255 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] Set router 09c83440-160f-4872-866e-39bee65fe6ab gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:03:34.771381 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.783666 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=fc90a0fd-7ca9-4a92-a265-28ce1dd9160f,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:34.787444 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:34.856458 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-e61c9e89-48be-4269-99b8-21bc1b5814a6 None None] Provisioning for port 68867abb-4eea-4548-9fa0-32ed4c61ef87 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:34.860433 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-e61c9e89-48be-4269-99b8-21bc1b5814a6 None None] Provisioning complete for port 68867abb-4eea-4548-9fa0-32ed4c61ef87 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:34.860873 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-e61c9e89-48be-4269-99b8-21bc1b5814a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.908151 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-e61c9e89-48be-4269-99b8-21bc1b5814a6 None None] Port 68867abb-4eea-4548-9fa0-32ed4c61ef87 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:03:34.913755 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:34.918325 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:34.918970 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:34.923990 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09c83440-160f-4872-866e-39bee65fe6ab', 'name': 'tempest-TestMinimumBasicScenario-428147393-router', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:30Z', 'updated_at': '2021-06-17T11:03:32Z', 'revision_number': 3, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'gw_port': {'id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:a7:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09c83440-160f-4872-866e-39bee65fe6ab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:31Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:34.950033 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d208217-0c93-44ea-a6a9-7f660de92327 None None] The sync data for ids ['09c83440-160f-4872-866e-39bee65fe6ab'] in dv-cinder-773870-6-iscsi is: [{'id': '09c83440-160f-4872-866e-39bee65fe6ab', 'name': 'tempest-TestMinimumBasicScenario-428147393-router', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:30Z', 'updated_at': '2021-06-17T11:03:32Z', 'revision_number': 3, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'gw_port': {'id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:a7:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09c83440-160f-4872-866e-39bee65fe6ab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:31Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:03:34.958447 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:35.005380 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:35.010993 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:35.014402 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f216fb49-b00c-435b-9b3a-6923c426c0d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:35.044927 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=9a5c3d03-1d5b-4666-9ca6-b1bd433f5866,segment=NetworkSegment(a1ea3154-a16f-407e-87a0-2b5b223e448c),segment_id=a1ea3154-a16f-407e-87a0-2b5b223e448c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:35.081882 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Pushing event updated for resources: {'Port': ['ID=68867abb-4eea-4548-9fa0-32ed4c61ef87,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:35.083635 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-290e01fb-d04a-4be5-9739-91aa844f786b req-1dfea214-7194-4d1d-9eaf-8d9f0a7db689 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0639293 Jun 17 11:03:35.085882 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:35.090714 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7899558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8290591'] for router_interface, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:35.130973 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:35.136536 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:35.165507 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-290e01fb-d04a-4be5-9739-91aa844f786b req-886a33fe-d057-4558-9685-0805b24d6724 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:35.167336 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-290e01fb-d04a-4be5-9739-91aa844f786b req-886a33fe-d057-4558-9685-0805b24d6724 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 1098 time: 0.0560088 Jun 17 11:03:35.192002 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Network d8beeb1f-3611-4a57-a06b-8027d5a36842 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:03:35.194046 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=9a5c3d03-1d5b-4666-9ca6-b1bd433f5866,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:35.194480 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:35.197722 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:35.319822 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-290e01fb-d04a-4be5-9739-91aa844f786b req-a02378a8-a7ab-46c4-a790-0b3bce02ac6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:35.321291 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-290e01fb-d04a-4be5-9739-91aa844f786b req-a02378a8-a7ab-46c4-a790-0b3bce02ac6c service neutron] 10.222.0.25 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 911 time: 0.1252532 Jun 17 11:03:35.352369 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Router 09c83440-160f-4872-866e-39bee65fe6ab has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:03:35.407933 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37304) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:35.436406 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-290e01fb-d04a-4be5-9739-91aa844f786b req-c7cc68ab-7f1b-4e17-9654-d28cdc3b364c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=584d5dfc-3f46-4820-80b2-e729ce075654 HTTP/1.1" status: 200 len: 1000 time: 0.0908096 Jun 17 11:03:35.517220 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-290e01fb-d04a-4be5-9739-91aa844f786b req-d3614be7-3add-4af3-a1a8-30b4b6b612ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:35.518769 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-290e01fb-d04a-4be5-9739-91aa844f786b req-d3614be7-3add-4af3-a1a8-30b4b6b612ec service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 200 len: 849 time: 0.0745289 Jun 17 11:03:35.534994 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-8c085a4f-2bed-4536-835c-76c160770732 None None] Provisioning complete for port 68867abb-4eea-4548-9fa0-32ed4c61ef87 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:35.535388 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8c085a4f-2bed-4536-835c-76c160770732 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:35.573766 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-8c085a4f-2bed-4536-835c-76c160770732 None None] Port 68867abb-4eea-4548-9fa0-32ed4c61ef87 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:03:35.591573 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-290e01fb-d04a-4be5-9739-91aa844f786b req-11d5a652-dafe-4a22-8e25-096fa8856f69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:35.593109 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-290e01fb-d04a-4be5-9739-91aa844f786b req-11d5a652-dafe-4a22-8e25-096fa8856f69 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=54973ccd-0b2b-4517-ad28-76a3128a2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0638945 Jun 17 11:03:35.728879 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-290e01fb-d04a-4be5-9739-91aa844f786b req-07472f78-42c5-448e-a141-ce968a935ed9 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1277561 Jun 17 11:03:35.749461 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_v2 [None req-12e66ba1-1a54-4f5f-b073-012e825a422a admin admin] Deleting subnet c10bc074-5591-4fbf-953f-e4097d48cc79 {{(pid=110214) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:03:35.768761 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-12e66ba1-1a54-4f5f-b073-012e825a422a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:35.842903 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:03:35.855982 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] 10.222.0.41 "PUT /v2.0/routers/09c83440-160f-4872-866e-39bee65fe6ab/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5935974 Jun 17 11:03:35.856318 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-290e01fb-d04a-4be5-9739-91aa844f786b req-ba185a31-bcaa-4677-b3e9-540ef8e2719d service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0998640 Jun 17 11:03:35.876865 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-12e66ba1-1a54-4f5f-b073-012e825a422a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6228443'] for subnet, precommit_delete_associations {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:35.926924 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-12e66ba1-1a54-4f5f-b073-012e825a422a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.086347 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-12e66ba1-1a54-4f5f-b073-012e825a422a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6239301', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5530029'] for subnet, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.090008 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:36.125830 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-12e66ba1-1a54-4f5f-b073-012e825a422a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.127729 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-12e66ba1-1a54-4f5f-b073-012e825a422a admin admin] 10.222.0.41 "DELETE /v2.0/subnets/c10bc074-5591-4fbf-953f-e4097d48cc79 HTTP/1.1" status: 204 len: 168 time: 0.7206361 Jun 17 11:03:36.129303 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12e66ba1-1a54-4f5f-b073-012e825a422a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c10bc074-5591-4fbf-953f-e4097d48cc79,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:36.130680 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37322) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:36.135985 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-12e66ba1-1a54-4f5f-b073-012e825a422a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:36.155037 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:03:36.158610 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device fc90a0fd-7ca9-4a92-a265-28ce1dd9160f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:36.202764 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:03:36.203457 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 5df2bc70-d7c4-4355-b3d7-81d2732dfd9d not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:03:36.233418 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:36.233706 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.237287 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.327372 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 78b15da2-1d10-42eb-927c-9b229a7351ae up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:36.342347 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.376064 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b']}} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:36.388506 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f32f5ed9-539a-457e-8330-d3310fcdf7eb') {'for_net_delete': True} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:36.389066 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f32f5ed9-539a-457e-8330-d3310fcdf7eb') {} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:36.400410 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6032818'] for segment, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.417028 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.428937 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] Releasing vlan 146 on physical network physnet1 to pool {{(pid=110215) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:03:36.429591 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5898799'] for segment, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:03:36.431395 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: Traceback (most recent call last): Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: timer() Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: cb(*args, **kw) Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: return func(*args, **kwargs) Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: self._notify() Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: self.callback(batched_events) Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: event.method(event) Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: return f(self, *a, **k) Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._get(url).json() Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: return self.request(url, 'GET', **kwargs) Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:03:36.434036 dv-cinder-773870-6-iscsi neutron-server[110215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:03:36.490984 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 78b15da2-1d10-42eb-927c-9b229a7351ae completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:36.502788 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 78b15da2-1d10-42eb-927c-9b229a7351ae triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:36.504504 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.527163 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b745a71-0d84-428e-97f8-493ad6817d9f req-5d8e6a97-7ef9-496b-a1c6-3ea45ddd1f33 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:36.544600 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7b745a71-0d84-428e-97f8-493ad6817d9f req-5d8e6a97-7ef9-496b-a1c6-3ea45ddd1f33 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.1100929 Jun 17 11:03:36.566139 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d562d20-a0e6-451f-9b61-93d37867c646 req-6737d328-1ece-4f25-8673-93ab3ed24fe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:36.566139 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1d562d20-a0e6-451f-9b61-93d37867c646 req-6737d328-1ece-4f25-8673-93ab3ed24fe5 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 1098 time: 0.0668509 Jun 17 11:03:36.594885 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7b745a71-0d84-428e-97f8-493ad6817d9f req-e649ba1c-87fa-4eee-bce6-f09ed4a5eeca tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494328 Jun 17 11:03:36.610389 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.630907 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.630907 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] 10.222.0.41 "DELETE /v2.0/networks/bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b HTTP/1.1" status: 204 len: 168 time: 0.4926293 Jun 17 11:03:36.630907 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:36.642747 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.651889 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] Pushing event deleted for resources: {'Network': ['ID=bd67c47a-ae1c-45c7-bda2-2d5bcc1ace9b,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:36.654370 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-62630195-4434-43ea-99fb-2942318f0e02 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:36.670298 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 78b15da2-1d10-42eb-927c-9b229a7351ae, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=78b15da2-1d10-42eb-927c-9b229a7351ae,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:36.728605 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d562d20-a0e6-451f-9b61-93d37867c646 req-65722691-24b3-4547-b41c-28493c5e2e8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:36.730218 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1d562d20-a0e6-451f-9b61-93d37867c646 req-65722691-24b3-4547-b41c-28493c5e2e8a service neutron] 10.222.0.25 "GET /v2.0/networks?id=0fe823e2-06dd-4212-84a6-8e0beda57580 HTTP/1.1" status: 200 len: 920 time: 0.1481616 Jun 17 11:03:36.742301 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.743216 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:36.747336 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-276011e1-a940-4234-9c70-7451fd3dd31b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:36.778466 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1d562d20-a0e6-451f-9b61-93d37867c646 req-28594e53-9c32-4310-86f2-a4d6758d3180 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2ec3e896-70d1-4c47-933b-7234e4f744ed HTTP/1.1" status: 200 len: 217 time: 0.0401556 Jun 17 11:03:36.861877 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d562d20-a0e6-451f-9b61-93d37867c646 req-5f73ccd8-23f1-47f3-94c8-64fa4c75a897 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:36.863812 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1d562d20-a0e6-451f-9b61-93d37867c646 req-5f73ccd8-23f1-47f3-94c8-64fa4c75a897 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=ab7c7a9f-b422-4b40-b94a-6939be91bbb8 HTTP/1.1" status: 200 len: 859 time: 0.0760102 Jun 17 11:03:36.867435 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=78b15da2-1d10-42eb-927c-9b229a7351ae,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:36.875117 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:36.905258 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:36.905652 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:36.919885 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1d562d20-a0e6-451f-9b61-93d37867c646 req-11d29867-6d02-41f2-b3ea-6c2e3e631a4e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0fe823e2-06dd-4212-84a6-8e0beda57580&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0439141 Jun 17 11:03:36.938476 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:37.011946 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Sync routers for ids ['09c83440-160f-4872-866e-39bee65fe6ab'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:03:37.024460 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Routers {'09c83440-160f-4872-866e-39bee65fe6ab'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:03:37.025124 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:03:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['09c83440-160f-4872-866e-39bee65fe6ab'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:37.065189 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37356) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:37.075429 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1d562d20-a0e6-451f-9b61-93d37867c646 req-ee64e095-974c-4703-8d1c-88343f361512 service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1443450 Jun 17 11:03:37.116878 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-0f545a77-62f0-41ab-a7ca-3fec12f7fe1f admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=5a3d5a50b1194ca594e398fd941cbe5f&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0504744 Jun 17 11:03:37.119927 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37358) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:37.148300 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Set router 09c83440-160f-4872-866e-39bee65fe6ab gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:03:37.180189 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f53c7f3f-00d9-4ef8-a857-de7928c254a1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:37.208701 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1d562d20-a0e6-451f-9b61-93d37867c646 req-536c8777-27bf-4c1c-ae23-1f269e197e3a service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1222289 Jun 17 11:03:37.212652 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f53c7f3f-00d9-4ef8-a857-de7928c254a1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:37.400031 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f53c7f3f-00d9-4ef8-a857-de7928c254a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:37.403283 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f53c7f3f-00d9-4ef8-a857-de7928c254a1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:37.415407 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-f53c7f3f-00d9-4ef8-a857-de7928c254a1 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/dacbbfe2-8495-44e2-8e63-e6445fb4ef4f HTTP/1.1" status: 204 len: 168 time: 0.2900438 Jun 17 11:03:37.417113 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9a9eb513-3b05-4529-894c-690eea3dfa37 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:37.436369 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53c7f3f-00d9-4ef8-a857-de7928c254a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dacbbfe2-8495-44e2-8e63-e6445fb4ef4f,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:37.449919 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f53c7f3f-00d9-4ef8-a857-de7928c254a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:37.593820 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09c83440-160f-4872-866e-39bee65fe6ab', 'name': 'tempest-TestMinimumBasicScenario-428147393-router', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:30Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 4, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'gw_port': {'id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:a7:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09c83440-160f-4872-866e-39bee65fe6ab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:31Z', 'updated_at': '2021-06-17T11:03:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '68867abb-4eea-4548-9fa0-32ed4c61ef87', 'name': '', 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'mac_address': 'fa:16:3e:e8:75:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09c83440-160f-4872-866e-39bee65fe6ab', 'device_owner': 'network:router_interface', 'standard_attr_id': 455, 'fixed_ips': [{'subnet_id': '8a8d9b36-b457-42ac-b365-dc16ef24b559', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:33Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 2, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'subnets': [{'id': '8a8d9b36-b457-42ac-b365-dc16ef24b559', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:37.708446 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Checking router: 09c83440-160f-4872-866e-39bee65fe6ab for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:03:37.708815 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Updating router 09c83440-160f-4872-866e-39bee65fe6ab port 68867abb-4eea-4548-9fa0-32ed4c61ef87 binding host dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:03:37.750682 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:37.968050 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-761682d4-838d-4c71-a443-63139b435024 req-79e99c71-5b2b-4621-9367-dd261bc78978 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:37.968050 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-761682d4-838d-4c71-a443-63139b435024 req-79e99c71-5b2b-4621-9367-dd261bc78978 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.1275442 Jun 17 11:03:37.968050 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-761682d4-838d-4c71-a443-63139b435024 req-387fe36a-29a6-45f1-944c-7c92a3a03493 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554931 Jun 17 11:03:38.136694 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 78b15da2-1d10-42eb-927c-9b229a7351ae up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:38.196374 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Notify callbacks [] for port, precommit_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:38.210788 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Transition to ACTIVE for port object 68867abb-4eea-4548-9fa0-32ed4c61ef87 will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:38.220120 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 78b15da2-1d10-42eb-927c-9b229a7351ae triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:38.220652 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:38.513917 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:38.521238 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:38.660255 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb83854c-ba7b-41e2-8ba3-86e99e7c1b31 None None] Pushing event updated for resources: {'Port': ['ID=68867abb-4eea-4548-9fa0-32ed4c61ef87,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:38.667141 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-bb83854c-ba7b-41e2-8ba3-86e99e7c1b31 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:38.703899 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Attempting to bind port 68867abb-4eea-4548-9fa0-32ed4c61ef87 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:03:38.704350 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Attempting to bind port 68867abb-4eea-4548-9fa0-32ed4c61ef87 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': 'a1ea3154-a16f-407e-87a0-2b5b223e448c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:03:38.704786 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Attempting to bind port 68867abb-4eea-4548-9fa0-32ed4c61ef87 on network d8beeb1f-3611-4a57-a06b-8027d5a36842 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:03:38.716362 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 3, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:03:38.716740 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Checking segment: {'id': 'a1ea3154-a16f-407e-87a0-2b5b223e448c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:03:38.717153 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:38.717595 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Bound using segment: {'id': 'a1ea3154-a16f-407e-87a0-2b5b223e448c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:03:38.718188 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Bound port: 68867abb-4eea-4548-9fa0-32ed4c61ef87, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a1ea3154-a16f-407e-87a0-2b5b223e448c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:03:38.718618 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:38.838253 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] For port 68867abb-4eea-4548-9fa0-32ed4c61ef87, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:03:38.841493 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] For port 68867abb-4eea-4548-9fa0-32ed4c61ef87, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=68867abb-4eea-4548-9fa0-32ed4c61ef87,segment=NetworkSegment(a1ea3154-a16f-407e-87a0-2b5b223e448c),segment_id=a1ea3154-a16f-407e-87a0-2b5b223e448c)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:03:38.926860 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:38.929827 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-bb83854c-ba7b-41e2-8ba3-86e99e7c1b31 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:39.012547 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Routers {'09c83440-160f-4872-866e-39bee65fe6ab'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:03:39.013312 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:03:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['09c83440-160f-4872-866e-39bee65fe6ab'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:39.060293 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb83854c-ba7b-41e2-8ba3-86e99e7c1b31 None None] Pushing event updated for resources: {'Port': ['ID=68867abb-4eea-4548-9fa0-32ed4c61ef87,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:39.174458 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] Set router 09c83440-160f-4872-866e-39bee65fe6ab gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:03:39.268423 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-bb83854c-ba7b-41e2-8ba3-86e99e7c1b31 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.338s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:39.322959 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad79541d-eafd-4509-9bf9-c6197791312e req-6adb9b87-ab27-4ac5-b0df-4c373486f4bd tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:39.331469 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ad79541d-eafd-4509-9bf9-c6197791312e req-6adb9b87-ab27-4ac5-b0df-4c373486f4bd tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.1318648 Jun 17 11:03:39.371424 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ad79541d-eafd-4509-9bf9-c6197791312e req-bc6c9e08-450c-4a79-802f-9085a68990a0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377672 Jun 17 11:03:39.437461 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09c83440-160f-4872-866e-39bee65fe6ab', 'name': 'tempest-TestMinimumBasicScenario-428147393-router', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:30Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 4, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'gw_port': {'id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:a7:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09c83440-160f-4872-866e-39bee65fe6ab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:31Z', 'updated_at': '2021-06-17T11:03:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '68867abb-4eea-4548-9fa0-32ed4c61ef87', 'name': '', 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'mac_address': 'fa:16:3e:e8:75:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09c83440-160f-4872-866e-39bee65fe6ab', 'device_owner': 'network:router_interface', 'standard_attr_id': 455, 'fixed_ips': [{'subnet_id': '8a8d9b36-b457-42ac-b365-dc16ef24b559', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:33Z', 'updated_at': '2021-06-17T11:03:38Z', 'revision_number': 4, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'subnets': [{'id': '8a8d9b36-b457-42ac-b365-dc16ef24b559', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:03:39.470688 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaea4c40-f6b9-481d-936d-6523f1196f9f None None] The sync data for ids ['09c83440-160f-4872-866e-39bee65fe6ab'] in dv-cinder-773870-6-iscsi is: [{'id': '09c83440-160f-4872-866e-39bee65fe6ab', 'name': 'tempest-TestMinimumBasicScenario-428147393-router', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:30Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 4, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'gw_port': {'id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:a7:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09c83440-160f-4872-866e-39bee65fe6ab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:31Z', 'updated_at': '2021-06-17T11:03:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '68867abb-4eea-4548-9fa0-32ed4c61ef87', 'name': '', 'network_id': 'd8beeb1f-3611-4a57-a06b-8027d5a36842', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'mac_address': 'fa:16:3e:e8:75:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '09c83440-160f-4872-866e-39bee65fe6ab', 'device_owner': 'network:router_interface', 'standard_attr_id': 455, 'fixed_ips': [{'subnet_id': '8a8d9b36-b457-42ac-b365-dc16ef24b559', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:33Z', 'updated_at': '2021-06-17T11:03:38Z', 'revision_number': 4, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'subnets': [{'id': '8a8d9b36-b457-42ac-b365-dc16ef24b559', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:03:40.134840 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 68867abb-4eea-4548-9fa0-32ed4c61ef87 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:40.302724 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 68867abb-4eea-4548-9fa0-32ed4c61ef87 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:40.309877 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 68867abb-4eea-4548-9fa0-32ed4c61ef87 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:40.310253 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:40.448540 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:40.490554 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 68867abb-4eea-4548-9fa0-32ed4c61ef87, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=68867abb-4eea-4548-9fa0-32ed4c61ef87,segment=NetworkSegment(a1ea3154-a16f-407e-87a0-2b5b223e448c),segment_id=a1ea3154-a16f-407e-87a0-2b5b223e448c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:03:40.613326 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc4a57b5-8860-4c83-9b8d-04dd26b9771e req-02e9f385-8b6b-4643-9183-eb191029f79d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:40.616641 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bc4a57b5-8860-4c83-9b8d-04dd26b9771e req-02e9f385-8b6b-4643-9183-eb191029f79d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0832362 Jun 17 11:03:40.633464 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:40.638063 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:40.697574 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bc4a57b5-8860-4c83-9b8d-04dd26b9771e req-ef361f78-0ec8-41cf-9dfa-96f746c7e04b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747690 Jun 17 11:03:40.734447 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=68867abb-4eea-4548-9fa0-32ed4c61ef87,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:40.744793 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:41.914947 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961811a5-85ab-4940-b953-3bac38e93a6c req-206ca96b-75bb-4e9b-ad6b-1c38ec5c2cf5 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:41.918163 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-961811a5-85ab-4940-b953-3bac38e93a6c req-206ca96b-75bb-4e9b-ad6b-1c38ec5c2cf5 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0782900 Jun 17 11:03:41.962680 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-961811a5-85ab-4940-b953-3bac38e93a6c req-5e94d488-d6b8-41f2-930f-00eb214ae530 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380569 Jun 17 11:03:42.076976 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 68867abb-4eea-4548-9fa0-32ed4c61ef87 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:03:42.138739 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 68867abb-4eea-4548-9fa0-32ed4c61ef87 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:42.139501 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:42.145949 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37456) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:42.321496 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d9dae1a4-2e67-4224-9e76-68103a568bbe admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:42.424858 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d9dae1a4-2e67-4224-9e76-68103a568bbe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:42.507859 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d9dae1a4-2e67-4224-9e76-68103a568bbe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:42.510324 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a482f60c-f6c0-4688-887d-dfae1327c80d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:42.552047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37462) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:42.559884 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-d9dae1a4-2e67-4224-9e76-68103a568bbe admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=0360d4fb70ae44a18da7bda5a211d2bb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4127178 Jun 17 11:03:42.564561 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9dae1a4-2e67-4224-9e76-68103a568bbe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=774c4854-be10-4812-8043-ec882fa4c3ce,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:42.570137 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d9dae1a4-2e67-4224-9e76-68103a568bbe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:42.609996 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4525e471-9ac4-407d-bffb-fae2d93022be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:42.632469 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4525e471-9ac4-407d-bffb-fae2d93022be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:42.753811 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4525e471-9ac4-407d-bffb-fae2d93022be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:42.757251 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4525e471-9ac4-407d-bffb-fae2d93022be admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:42.758567 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-4525e471-9ac4-407d-bffb-fae2d93022be admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/774c4854-be10-4812-8043-ec882fa4c3ce HTTP/1.1" status: 204 len: 168 time: 0.2048316 Jun 17 11:03:42.759397 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cb942c14-4285-49d3-b5e3-7b0a83e9c157 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:42.768766 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4525e471-9ac4-407d-bffb-fae2d93022be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=774c4854-be10-4812-8043-ec882fa4c3ce,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:42.777489 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4525e471-9ac4-407d-bffb-fae2d93022be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:43.180213 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-657d21e7-41d2-43bb-8f26-cd8c1241714c req-90ecdbc2-3599-466b-bf08-d8b27e0d69cd tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:43.187226 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-657d21e7-41d2-43bb-8f26-cd8c1241714c req-90ecdbc2-3599-466b-bf08-d8b27e0d69cd tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0790372 Jun 17 11:03:43.225743 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-657d21e7-41d2-43bb-8f26-cd8c1241714c req-1672b0b6-f702-40c8-a145-9b6f1d902836 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375464 Jun 17 11:03:43.406385 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37474) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:43.424193 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9feaaf74-4bca-46c5-ab7b-6ca118c211a4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:43.547644 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9feaaf74-4bca-46c5-ab7b-6ca118c211a4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:43.616836 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9feaaf74-4bca-46c5-ab7b-6ca118c211a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:43.619735 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d9dae1a4-2e67-4224-9e76-68103a568bbe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:43.658583 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-9feaaf74-4bca-46c5-ab7b-6ca118c211a4 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=22e99baf45ae4210b8c193356b4d7d99&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2491286 Jun 17 11:03:43.658583 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9feaaf74-4bca-46c5-ab7b-6ca118c211a4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d770ae6-77f4-4062-9d28-4d3fc9d40f31,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:43.662054 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9feaaf74-4bca-46c5-ab7b-6ca118c211a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:43.664459 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37480) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:43.757349 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f1fe6949-19a9-4890-8547-29acbf3afa3c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:43.782546 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f1fe6949-19a9-4890-8547-29acbf3afa3c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:43.919250 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f1fe6949-19a9-4890-8547-29acbf3afa3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:43.921882 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f1fe6949-19a9-4890-8547-29acbf3afa3c admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:43.923070 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f1fe6949-19a9-4890-8547-29acbf3afa3c admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/4d770ae6-77f4-4062-9d28-4d3fc9d40f31 HTTP/1.1" status: 204 len: 168 time: 0.2574375 Jun 17 11:03:43.924658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-af97a421-b3d1-4391-82d4-fbfa408e5339 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:43.947226 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1fe6949-19a9-4890-8547-29acbf3afa3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d770ae6-77f4-4062-9d28-4d3fc9d40f31,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:43.950781 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f1fe6949-19a9-4890-8547-29acbf3afa3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:44.044252 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa5ae6b-7167-4676-8bd9-53b36cad5d5f req-7124a46b-96ce-4599-acbe-1766ce8bf799 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:44.054519 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2aa5ae6b-7167-4676-8bd9-53b36cad5d5f req-7124a46b-96ce-4599-acbe-1766ce8bf799 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.1660604 Jun 17 11:03:44.135527 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2aa5ae6b-7167-4676-8bd9-53b36cad5d5f req-3f5f8696-a239-42a9-9212-37670325f789 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0799596 Jun 17 11:03:44.491343 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faef31e4-b854-45be-a08d-5f61e949c031 req-0ea04a40-f37f-428f-bfb3-4d4f9613bd3f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:44.492817 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-faef31e4-b854-45be-a08d-5f61e949c031 req-0ea04a40-f37f-428f-bfb3-4d4f9613bd3f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.1025672 Jun 17 11:03:44.536572 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-faef31e4-b854-45be-a08d-5f61e949c031 req-b94a6b42-34ce-4a5c-8c6e-95767c8e9312 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327148 Jun 17 11:03:45.400594 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6258020a-470b-46d0-9e27-04575cdbd0aa req-9b145a4e-5fca-4c5a-8f42-9acd5d0e8597 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:45.402542 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6258020a-470b-46d0-9e27-04575cdbd0aa req-9b145a4e-5fca-4c5a-8f42-9acd5d0e8597 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0787692 Jun 17 11:03:45.455429 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6258020a-470b-46d0-9e27-04575cdbd0aa req-653e4e62-4ac8-44d4-ba48-2660a508259e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460846 Jun 17 11:03:45.797043 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cdd94f9-be99-40c2-846a-c2f1a22b77aa req-320b7fa0-321d-4e33-904a-99dc413ebf24 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:45.807485 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8cdd94f9-be99-40c2-846a-c2f1a22b77aa req-320b7fa0-321d-4e33-904a-99dc413ebf24 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.1040378 Jun 17 11:03:45.857380 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8cdd94f9-be99-40c2-846a-c2f1a22b77aa req-840df977-a6aa-4f9d-ad5e-8171229d8b29 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488915 Jun 17 11:03:46.663995 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-186d1eb6-a8f6-45ca-9fc0-e7c9ecbb6750 req-41e6ff3a-ef8c-418b-8f1d-54de20b5a107 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:46.666344 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-186d1eb6-a8f6-45ca-9fc0-e7c9ecbb6750 req-41e6ff3a-ef8c-418b-8f1d-54de20b5a107 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0770149 Jun 17 11:03:46.722241 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-186d1eb6-a8f6-45ca-9fc0-e7c9ecbb6750 req-5ac93229-b150-473b-af73-6a0829af6106 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477071 Jun 17 11:03:47.052885 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e8aa80-a12a-46eb-a184-391a091d982a req-7d997b3c-d69e-4394-b815-8e580e2996f8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:47.054485 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-90e8aa80-a12a-46eb-a184-391a091d982a req-7d997b3c-d69e-4394-b815-8e580e2996f8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0757029 Jun 17 11:03:47.099924 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-90e8aa80-a12a-46eb-a184-391a091d982a req-4dc7fe11-0e03-415c-9cd8-0d4dea10c484 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390601 Jun 17 11:03:47.935047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9419b45f-4010-4321-9659-4e90fc53408c req-d4551e77-f65c-4a2a-98ee-491afe5f84ab tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:47.936630 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9419b45f-4010-4321-9659-4e90fc53408c req-d4551e77-f65c-4a2a-98ee-491afe5f84ab tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0792565 Jun 17 11:03:47.979224 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9419b45f-4010-4321-9659-4e90fc53408c req-022c0181-3ba5-4dcb-a7a9-ec1b1427ffe2 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0356066 Jun 17 11:03:48.313939 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c015b2-6858-4c5f-aa0e-b53b4700004a req-00413259-2ad3-4a49-8631-c55c85cae7b9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:48.316685 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a2c015b2-6858-4c5f-aa0e-b53b4700004a req-00413259-2ad3-4a49-8631-c55c85cae7b9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0708292 Jun 17 11:03:48.355594 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a2c015b2-6858-4c5f-aa0e-b53b4700004a req-9facdb72-6389-4fc4-8a1d-82061fa2fbfa tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331428 Jun 17 11:03:49.162934 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b5ec33-0415-45ba-acff-9467e1fef6ee req-3213402b-5d31-43c2-8ef5-cbd0b67e7436 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:49.164385 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b7b5ec33-0415-45ba-acff-9467e1fef6ee req-3213402b-5d31-43c2-8ef5-cbd0b67e7436 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0634930 Jun 17 11:03:49.203415 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b7b5ec33-0415-45ba-acff-9467e1fef6ee req-4e117051-18c0-4120-8d1a-9770eec8e7f6 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0332112 Jun 17 11:03:49.537738 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd3935b-e4dc-47c7-a62f-ea469b3a1925 req-242c8f66-2735-4d01-9a06-5fea3e162a60 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:49.539299 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ecd3935b-e4dc-47c7-a62f-ea469b3a1925 req-242c8f66-2735-4d01-9a06-5fea3e162a60 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0692749 Jun 17 11:03:49.584582 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ecd3935b-e4dc-47c7-a62f-ea469b3a1925 req-262bfb36-3b33-4db7-a8b8-a9bb8e090bde tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395992 Jun 17 11:03:50.325106 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-a6bd7e5c-1be9-4f85-9965-5e29f2135f46 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:50.326564 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-a6bd7e5c-1be9-4f85-9965-5e29f2135f46 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/networks?id=aeced3ed-7670-4043-a385-87de6f75150b HTTP/1.1" status: 200 len: 815 time: 0.1111531 Jun 17 11:03:50.342666 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-12e43c46-8414-4de5-adfe-1df6406273b9 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/quotas/ed69cf6aa40941c48c25effb0c1af8fc HTTP/1.1" status: 200 len: 375 time: 0.0099177 Jun 17 11:03:50.399470 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48260d7-20c1-4a71-ac88-bc29b1ca0421 req-465009cb-f57d-4dfb-9127-809eb68b5492 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:50.400943 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c48260d7-20c1-4a71-ac88-bc29b1ca0421 req-465009cb-f57d-4dfb-9127-809eb68b5492 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0649025 Jun 17 11:03:50.418832 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-798377c4-615b-4132-a212-53f28194f02d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=ed69cf6aa40941c48c25effb0c1af8fc&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0700505 Jun 17 11:03:50.456232 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c48260d7-20c1-4a71-ac88-bc29b1ca0421 req-8e6f4d4f-d251-4acb-9931-aaabf10b8da5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493512 Jun 17 11:03:50.527652 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2a2dc5ea-bce9-47a9-afdb-a22aebff96e0 service neutron] 10.222.0.41 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0940104 Jun 17 11:03:50.631818 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-69cdb2ac-d3a2-4070-b2c1-152d27f208e2 service neutron] 10.222.0.41 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0993004 Jun 17 11:03:50.637893 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-26e8d22a-4242-47d1-885f-c2b2f1e36ca7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:50.767862 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6abb4f9-bedc-444d-a7af-828ae96da583 req-7fdbc40e-755a-4e72-8580-6cfb684d560c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:50.769328 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c6abb4f9-bedc-444d-a7af-828ae96da583 req-7fdbc40e-755a-4e72-8580-6cfb684d560c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0648015 Jun 17 11:03:50.807447 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c6abb4f9-bedc-444d-a7af-828ae96da583 req-90b00a10-accd-433d-8925-002ce9ba12ff tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325394 Jun 17 11:03:50.936017 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-db65070c-49f7-4bc7-9f5e-9e313bda229b req-1d8487f5-97b6-4593-baa3-4c55711cf278 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 210 time: 0.0317693 Jun 17 11:03:51.046198 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37696) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:51.152764 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-144033f8-9549-444b-9169-c446e9a4ebad admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:51.241023 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-144033f8-9549-444b-9169-c446e9a4ebad admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:51.314241 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-144033f8-9549-444b-9169-c446e9a4ebad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:51.318004 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-b7779081-e10e-4779-985e-71ff77ac646d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:51.358669 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-144033f8-9549-444b-9169-c446e9a4ebad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7023cccf-7324-4aab-b63b-a6a5bf955969,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:51.361752 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-144033f8-9549-444b-9169-c446e9a4ebad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:51.364798 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-144033f8-9549-444b-9169-c446e9a4ebad admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=bf7b6836821c4ad7ae73a1545f92afc7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3172739 Jun 17 11:03:51.367432 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37700) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:51.425120 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d1781734-f0d5-4774-8270-bfd56c465779 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:51.449646 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d1781734-f0d5-4774-8270-bfd56c465779 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:51.603346 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d1781734-f0d5-4774-8270-bfd56c465779 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:51.606075 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d1781734-f0d5-4774-8270-bfd56c465779 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:51.607255 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-d1781734-f0d5-4774-8270-bfd56c465779 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/7023cccf-7324-4aab-b63b-a6a5bf955969 HTTP/1.1" status: 204 len: 168 time: 0.2388420 Jun 17 11:03:51.609224 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-46047514-44f3-46b3-81bd-57a7a2e3e03a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:51.647909 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1781734-f0d5-4774-8270-bfd56c465779 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7023cccf-7324-4aab-b63b-a6a5bf955969,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:51.647909 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d1781734-f0d5-4774-8270-bfd56c465779 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:51.678286 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54a1be46-f422-4191-9394-b27c5f65d13a req-7a795faf-3327-4952-af41-4919c46d2faa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:51.687984 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54a1be46-f422-4191-9394-b27c5f65d13a req-7a795faf-3327-4952-af41-4919c46d2faa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0925276 Jun 17 11:03:51.721186 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54a1be46-f422-4191-9394-b27c5f65d13a req-2752842d-365f-4ff0-b737-0582bd690b4c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0340924 Jun 17 11:03:51.989100 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5825db3b-f50f-418e-8cd7-a1bb3633a242 req-a9f099f4-cffa-4454-b05e-01e7777e1006 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:51.994426 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5825db3b-f50f-418e-8cd7-a1bb3633a242 req-a9f099f4-cffa-4454-b05e-01e7777e1006 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0649879 Jun 17 11:03:52.029974 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5825db3b-f50f-418e-8cd7-a1bb3633a242 req-2316d4ea-3021-436c-a035-246959941f29 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327156 Jun 17 11:03:52.079757 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-bfc6cda6-1f9e-4193-821f-d9992ff8af90 req-dfce328f-d329-454d-9d84-105cc4796a45 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 210 time: 0.0306075 Jun 17 11:03:52.226296 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37716) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:52.240215 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-aa861586-c988-4846-9bd5-ee5995008259 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:52.324167 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-aa861586-c988-4846-9bd5-ee5995008259 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:52.399094 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-aa861586-c988-4846-9bd5-ee5995008259 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:52.401649 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-13256a81-beb4-4b90-a807-90ad9322f498 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:52.435864 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa861586-c988-4846-9bd5-ee5995008259 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0049a585-02c6-4da5-bc86-88f947953dce,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:52.440012 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-aa861586-c988-4846-9bd5-ee5995008259 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=772e2c9d36ce49e2b9e777f32790bee0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2125723 Jun 17 11:03:52.440906 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-aa861586-c988-4846-9bd5-ee5995008259 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:52.443405 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37718) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:52.500789 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d6987cbf-9113-4b08-a42c-04aa57f9668e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:52.527968 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d6987cbf-9113-4b08-a42c-04aa57f9668e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:52.639235 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d6987cbf-9113-4b08-a42c-04aa57f9668e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:52.641809 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d6987cbf-9113-4b08-a42c-04aa57f9668e admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:52.643000 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-d6987cbf-9113-4b08-a42c-04aa57f9668e admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/0049a585-02c6-4da5-bc86-88f947953dce HTTP/1.1" status: 204 len: 168 time: 0.1985264 Jun 17 11:03:52.643758 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-df5ba3e7-5609-4e6f-8038-832601a26c89 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:52.653898 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6987cbf-9113-4b08-a42c-04aa57f9668e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0049a585-02c6-4da5-bc86-88f947953dce,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:52.654742 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d6987cbf-9113-4b08-a42c-04aa57f9668e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:52.921728 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d435f35-2c97-445b-9186-8a5b0d19b4da req-3592e043-6de7-421e-afbf-46f85e3c1719 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:52.923190 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2d435f35-2c97-445b-9186-8a5b0d19b4da req-3592e043-6de7-421e-afbf-46f85e3c1719 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0674536 Jun 17 11:03:52.960714 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2d435f35-2c97-445b-9186-8a5b0d19b4da req-1fb0d674-c2b3-4125-921b-4dcab0adfd89 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319254 Jun 17 11:03:53.235415 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e2e56c5-6ca5-4747-983a-77320ea7cde3 req-2f303117-1d92-4369-98e8-d16b58672d1e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:53.237660 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1e2e56c5-6ca5-4747-983a-77320ea7cde3 req-2f303117-1d92-4369-98e8-d16b58672d1e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0900166 Jun 17 11:03:53.245780 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8827220d-2972-4a4a-a03c-fd671eb7d3c6 req-f4a6a5ca-5286-4005-b65b-9ce3fa3b64c5 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 210 time: 0.0295372 Jun 17 11:03:53.285748 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1e2e56c5-6ca5-4747-983a-77320ea7cde3 req-b01e26c1-39be-4da3-a07f-01b9e6cc7b0f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405514 Jun 17 11:03:53.365412 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1366efd1-ec88-4caf-bcf7-bb7deb022770 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:53.582120 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:53.741998 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-c40e0c4d-5d72-4443-ab87-fd72a1c3a2bb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:53.743483 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-c40e0c4d-5d72-4443-ab87-fd72a1c3a2bb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.25 "GET /v2.0/networks?id=aeced3ed-7670-4043-a385-87de6f75150b HTTP/1.1" status: 200 len: 815 time: 0.3521950 Jun 17 11:03:53.756988 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Request body: {'port': {'device_id': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'admin_state_up': True, 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:03:53.965173 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Made reservation on behalf of ed69cf6aa40941c48c25effb0c1af8fc for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:03:53.968660 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:54.135029 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Allocated IP 172.20.0.14 (aeced3ed-7670-4043-a385-87de6f75150b/5d332463-1c62-46e2-a7e3-4b587a2e5f1e/5c1891f0-4e28-4fb7-9fc3-1e92c03cef72) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:03:54.194581 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f81a1bf1-da0f-4c74-adae-aa0a0ef04538 req-71b8a750-d4d7-4a08-833c-b12cd70f3383 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:54.196286 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f81a1bf1-da0f-4c74-adae-aa0a0ef04538 req-71b8a750-d4d7-4a08-833c-b12cd70f3383 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.1163776 Jun 17 11:03:54.278716 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f81a1bf1-da0f-4c74-adae-aa0a0ef04538 req-777181eb-b89c-4681-8e8e-f6f31e5d6559 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0754566 Jun 17 11:03:54.369961 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:54.386994 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Transition to ACTIVE for port object 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:54.427681 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b7756ec6-edcb-43bf-a2fb-b8c9df1d7307 req-74347f59-1127-4fe8-b524-fbad6356867a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 210 time: 0.0397842 Jun 17 11:03:54.439647 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:54.490765 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:54.502648 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d74b2955-9c45-4cef-9c2b-ddec53c22135 req-92b836c0-5885-4d08-a1db-7aa7a50ef60c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:54.504677 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d74b2955-9c45-4cef-9c2b-ddec53c22135 req-92b836c0-5885-4d08-a1db-7aa7a50ef60c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0692375 Jun 17 11:03:54.505233 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:54.564693 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Network aeced3ed-7670-4043-a385-87de6f75150b is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:03:54.578141 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:03:54.578141 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:03:54.600482 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d74b2955-9c45-4cef-9c2b-ddec53c22135 req-dd00be0a-20f7-4ef0-a9ad-b837d94cb8c6 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887516 Jun 17 11:03:54.622836 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'Port': ['ID=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:54.629250 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:54.651206 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:54.655184 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:54.731827 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9793754 Jun 17 11:03:54.745080 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Request body: {'port': {'device_id': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:03:54.898774 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:54.982337 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-8ae54121-e35d-480d-a202-7ce83736e734 None None] Provisioning for port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:03:54.987495 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-8ae54121-e35d-480d-a202-7ce83736e734 None None] Provisioning complete for port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:03:54.996389 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8ae54121-e35d-480d-a202-7ce83736e734 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:55.061077 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-8ae54121-e35d-480d-a202-7ce83736e734 None None] Port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:03:55.291006 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:03:55.298636 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:55.340755 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Transition to ACTIVE for port object 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:03:55.421783 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:55.424520 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:55.509331 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-304cddcb-311d-48ef-8ad2-54266008b54d req-829fbfea-4d54-4265-9982-4ad26826c369 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:55.527489 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-304cddcb-311d-48ef-8ad2-54266008b54d req-829fbfea-4d54-4265-9982-4ad26826c369 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.1027908 Jun 17 11:03:55.549664 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Pushing event updated for resources: {'Port': ['ID=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:55.591416 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-304cddcb-311d-48ef-8ad2-54266008b54d req-1a3210a0-e68e-4372-9958-417289f4b921 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0629160 Jun 17 11:03:55.603201 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:55.768779 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37814) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:55.783735 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Attempting to bind port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:03:55.784252 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Attempting to bind port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:03:55.784792 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Attempting to bind port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 on network aeced3ed-7670-4043-a385-87de6f75150b {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:03:55.792834 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 on network aeced3ed-7670-4043-a385-87de6f75150b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:03:55.793645 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Attempting to bind port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 on network aeced3ed-7670-4043-a385-87de6f75150b {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:03:55.820548 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 3, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:03:55.821595 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Checking segment: {'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:03:55.822171 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Bound using segment: {'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:03:55.822604 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Bound port: 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:03:55.822985 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:55.851248 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa458418-82be-4221-802b-dcdc73d53f5c req-149a077f-2c4a-450d-9838-895e6b81e7e7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:55.852780 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fa458418-82be-4221-802b-dcdc73d53f5c req-149a077f-2c4a-450d-9838-895e6b81e7e7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.2165456 Jun 17 11:03:55.859085 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdbf2522-e336-43a4-aa33-78caabeef277 req-1fb365f5-c857-415d-bfaa-b9f175c3b306 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:55.860868 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-bdbf2522-e336-43a4-aa33-78caabeef277 req-1fb365f5-c857-415d-bfaa-b9f175c3b306 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0700302 Jun 17 11:03:55.909953 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-bdbf2522-e336-43a4-aa33-78caabeef277 req-496ec29a-c8be-4e43-a85b-3842f7ade293 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413651 Jun 17 11:03:55.931763 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fa458418-82be-4221-802b-dcdc73d53f5c req-b2cef562-0cfd-490a-9c6d-bf9b41f8254f tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520318 Jun 17 11:03:55.944711 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] For port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:03:55.948148 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] For port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:03:55.953192 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ac693558-0ef1-4b6e-8b6a-5fb94398bc87 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:56.017153 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:56.019276 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-e63bf666-c0c7-45be-b4db-d37412e095e7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:56.053448 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:56.053914 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:56.055323 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] 10.222.0.25 "PUT /v2.0/ports/5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 HTTP/1.1" status: 200 len: 1094 time: 1.3156583 Jun 17 11:03:56.055968 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:03:56.061273 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0597963-6a12-429d-9b0a-42e285d7e1bd" -d '{"events": [{"name": "network-changed", "server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:03:56.069229 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ac693558-0ef1-4b6e-8b6a-5fb94398bc87 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:56.086180 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Pushing event updated for resources: {'Port': ['ID=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:56.094350 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:56.126358 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:03:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-53a8ed72-00ac-4b01-bf09-164583b1109c x-openstack-request-id: req-53a8ed72-00ac-4b01-bf09-164583b1109c {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:03:56.127013 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:03:56.127469 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-53a8ed72-00ac-4b01-bf09-164583b1109c {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:03:56.127912 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'status': 'completed', 'code': 200} Jun 17 11:03:56.159594 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ac693558-0ef1-4b6e-8b6a-5fb94398bc87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:56.163838 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d1781734-f0d5-4774-8270-bfd56c465779 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:56.204941 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-ac693558-0ef1-4b6e-8b6a-5fb94398bc87 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=c9b797d0e4bc48cf8cbad3018775a378&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4342234 Jun 17 11:03:56.206224 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac693558-0ef1-4b6e-8b6a-5fb94398bc87 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d1f9810-8bba-47ca-825b-4881bf9dda3a,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:56.207648 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37820) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:56.209672 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-ac693558-0ef1-4b6e-8b6a-5fb94398bc87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:56.279147 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e63ce721-6ecc-4070-9cbd-b1033f0f04a1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:56.299936 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e63ce721-6ecc-4070-9cbd-b1033f0f04a1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:56.440013 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e63ce721-6ecc-4070-9cbd-b1033f0f04a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:56.442609 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e63ce721-6ecc-4070-9cbd-b1033f0f04a1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:56.446446 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-e63ce721-6ecc-4070-9cbd-b1033f0f04a1 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/8d1f9810-8bba-47ca-825b-4881bf9dda3a HTTP/1.1" status: 204 len: 168 time: 0.2350671 Jun 17 11:03:56.446446 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-040b2247-1240-4b88-aaab-05a9d2b51331 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:56.452330 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e63ce721-6ecc-4070-9cbd-b1033f0f04a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d1f9810-8bba-47ca-825b-4881bf9dda3a,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:56.454569 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-e63ce721-6ecc-4070-9cbd-b1033f0f04a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:56.805492 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d2b7e8-dd1f-4002-81b9-0d733acb2ad7 req-b0e5abd0-3cf0-4f96-a2cd-d430b852999e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:56.807198 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-99d2b7e8-dd1f-4002-81b9-0d733acb2ad7 req-b0e5abd0-3cf0-4f96-a2cd-d430b852999e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0767720 Jun 17 11:03:56.810606 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:56.849684 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-99d2b7e8-dd1f-4002-81b9-0d733acb2ad7 req-de41bcfa-389f-4feb-b0e2-4763e2577e17 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0349169 Jun 17 11:03:57.052009 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37834) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:57.068760 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:57.124220 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0649ca8a-cf33-4771-87e2-9b3a7ef54eb9 req-da7374a5-3002-46bd-9715-517977df66b3 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:57.126392 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0649ca8a-cf33-4771-87e2-9b3a7ef54eb9 req-da7374a5-3002-46bd-9715-517977df66b3 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0836568 Jun 17 11:03:57.189746 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0649ca8a-cf33-4771-87e2-9b3a7ef54eb9 req-0f3222f7-5e91-47a2-8bbe-8a70d221f913 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558789 Jun 17 11:03:57.212317 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f863da89-eba1-426e-8493-124e56c2f0eb req-91ffafcc-b637-4dae-8b9c-7a47cd2f6d39 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:57.213813 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f863da89-eba1-426e-8493-124e56c2f0eb req-91ffafcc-b637-4dae-8b9c-7a47cd2f6d39 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.1416330 Jun 17 11:03:57.249863 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:57.267231 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f863da89-eba1-426e-8493-124e56c2f0eb req-064f0f87-7a7f-4dfe-b40d-d8df14ce5597 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459461 Jun 17 11:03:57.347893 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:57.350380 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ea5f116d-1e71-4431-b02b-431e76181237 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:57.384744 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6043d7cd-d7ed-450b-9c33-78edd5ad6b95,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:57.388401 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=5cce9a5b70264c088ef04b2812bfea9b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3358793 Jun 17 11:03:57.391171 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37836) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:03:57.394780 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.395284 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.395648 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.396001 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.396350 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.396700 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.397046 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.397397 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.397740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.398081 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.398426 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.398763 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:03:57.402635 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:57.440189 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-38ba5fbb-9df7-4af7-a66c-eead43371879 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:57.464348 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-38ba5fbb-9df7-4af7-a66c-eead43371879 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:57.593335 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-38ba5fbb-9df7-4af7-a66c-eead43371879 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:57.595896 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-38ba5fbb-9df7-4af7-a66c-eead43371879 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:03:57.597021 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-38ba5fbb-9df7-4af7-a66c-eead43371879 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/6043d7cd-d7ed-450b-9c33-78edd5ad6b95 HTTP/1.1" status: 204 len: 168 time: 0.2048285 Jun 17 11:03:57.597819 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a72cae5a-7be9-4c88-ba96-59e4f5a601d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:03:57.605899 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ba5fbb-9df7-4af7-a66c-eead43371879 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6043d7cd-d7ed-450b-9c33-78edd5ad6b95,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:03:57.611127 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-38ba5fbb-9df7-4af7-a66c-eead43371879 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:03:58.069479 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cdcc99c-43db-4153-9026-455d5630a213 req-02d04d3b-4f98-4ac2-88e8-2511c0ef899a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:58.071245 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9cdcc99c-43db-4153-9026-455d5630a213 req-02d04d3b-4f98-4ac2-88e8-2511c0ef899a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0971007 Jun 17 11:03:58.117315 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9cdcc99c-43db-4153-9026-455d5630a213 req-4271da62-5981-4f40-951e-691138015a59 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0342865 Jun 17 11:03:58.364494 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1eb980c-a373-43ae-a2c1-7e87c682917d req-6b3637f3-3d13-46a0-a8d0-93b023800aa9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:58.365987 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a1eb980c-a373-43ae-a2c1-7e87c682917d req-6b3637f3-3d13-46a0-a8d0-93b023800aa9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0670190 Jun 17 11:03:58.415713 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a1eb980c-a373-43ae-a2c1-7e87c682917d req-e6bed153-24be-4090-af1a-d13566294fc7 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419114 Jun 17 11:03:58.467889 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df26a85-09be-431c-98b6-c961c4f88469 req-3466deef-badd-4985-89e1-6d5daf996597 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:58.470204 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5df26a85-09be-431c-98b6-c961c4f88469 req-3466deef-badd-4985-89e1-6d5daf996597 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0714598 Jun 17 11:03:58.536273 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5df26a85-09be-431c-98b6-c961c4f88469 req-533f5a75-0c63-4c02-b170-f70f69b1a879 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561757 Jun 17 11:03:59.348500 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9275bfd-0752-45bf-84c9-58226486b1a2 req-05a9d14f-d414-420f-a08d-91f9ebe96382 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:59.350832 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9275bfd-0752-45bf-84c9-58226486b1a2 req-05a9d14f-d414-420f-a08d-91f9ebe96382 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0986850 Jun 17 11:03:59.415177 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9275bfd-0752-45bf-84c9-58226486b1a2 req-8937cd77-92f6-4aa3-a837-70eac252703d tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0512815 Jun 17 11:03:59.605979 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2357a9c8-8c01-4bfc-94b4-6fedb3fa21e4 req-eff91f30-cf81-4ed7-8a6d-1319dbed8c2f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:59.607486 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2357a9c8-8c01-4bfc-94b4-6fedb3fa21e4 req-eff91f30-cf81-4ed7-8a6d-1319dbed8c2f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0686398 Jun 17 11:03:59.654196 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2357a9c8-8c01-4bfc-94b4-6fedb3fa21e4 req-8aa04cea-53ae-49ad-9ef2-2f1568fafa3d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383327 Jun 17 11:03:59.728084 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5deff22-429c-455c-8640-3e358d5e52be req-94a86c95-61be-411e-a4c7-993bfeb26abc tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:03:59.729571 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e5deff22-429c-455c-8640-3e358d5e52be req-94a86c95-61be-411e-a4c7-993bfeb26abc tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0686948 Jun 17 11:03:59.767254 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e5deff22-429c-455c-8640-3e358d5e52be req-8b3b64a0-e323-4848-a656-6e57f80309c6 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321527 Jun 17 11:04:00.608191 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ca1893-a598-4f37-813b-9dd30879bf62 req-abe9981a-11da-4106-aef6-b8e985d64d56 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:00.609748 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-06ca1893-a598-4f37-813b-9dd30879bf62 req-abe9981a-11da-4106-aef6-b8e985d64d56 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0703685 Jun 17 11:04:00.656993 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-06ca1893-a598-4f37-813b-9dd30879bf62 req-5540f3cf-2727-4b09-87e2-8653cdcd2b74 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409346 Jun 17 11:04:00.854770 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d3d0a52-550e-41ff-8bab-13e85e05ac11 req-3d27c7ae-4f5a-40f5-8838-c017ac52fd43 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:00.859687 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37934) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:00.863764 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8d3d0a52-550e-41ff-8bab-13e85e05ac11 req-3d27c7ae-4f5a-40f5-8838-c017ac52fd43 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0877526 Jun 17 11:04:00.924612 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8d3d0a52-550e-41ff-8bab-13e85e05ac11 req-f6bd7bf8-55fb-447f-94dc-aa088f365342 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595653 Jun 17 11:04:01.029661 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc334b0b-a79b-49bd-966d-eceaaaa1f9fa req-63aa8965-f586-427b-b4d4-3bae79684516 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:01.031137 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-dc334b0b-a79b-49bd-966d-eceaaaa1f9fa req-63aa8965-f586-427b-b4d4-3bae79684516 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0920506 Jun 17 11:04:01.074841 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8218956e-924b-4821-925d-61503bd836f5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:01.089484 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-dc334b0b-a79b-49bd-966d-eceaaaa1f9fa req-8821b56f-cb03-4271-812f-c7120e51a173 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527158 Jun 17 11:04:01.174959 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8218956e-924b-4821-925d-61503bd836f5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:01.227647 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8218956e-924b-4821-925d-61503bd836f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:01.230008 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b172f274-5bcc-48f6-83b7-030346b92054 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:01.264231 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8218956e-924b-4821-925d-61503bd836f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59ebf03b-bdaa-45b3-a431-ce04d7bb2d8d,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:01.268442 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-8218956e-924b-4821-925d-61503bd836f5 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=e7fbc2281084460d9c6eb060664b7dad&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4075389 Jun 17 11:04:01.269461 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-8218956e-924b-4821-925d-61503bd836f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:01.271755 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37938) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:01.340021 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4ce82a6f-5563-45eb-9efc-648d57c2ff39 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:01.370604 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4ce82a6f-5563-45eb-9efc-648d57c2ff39 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:01.764800 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4ce82a6f-5563-45eb-9efc-648d57c2ff39 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:01.767606 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4ce82a6f-5563-45eb-9efc-648d57c2ff39 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:01.768842 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-4ce82a6f-5563-45eb-9efc-648d57c2ff39 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/59ebf03b-bdaa-45b3-a431-ce04d7bb2d8d HTTP/1.1" status: 204 len: 168 time: 0.4960914 Jun 17 11:04:01.770488 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-144033f8-9549-444b-9169-c446e9a4ebad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:01.788823 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ce82a6f-5563-45eb-9efc-648d57c2ff39 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59ebf03b-bdaa-45b3-a431-ce04d7bb2d8d,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:01.791176 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4ce82a6f-5563-45eb-9efc-648d57c2ff39 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:01.844677 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d74aa15-68f2-43b2-a78b-278819a56d76 req-a730b725-de2e-412f-b8cb-a6f866d480f6 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:01.846185 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8d74aa15-68f2-43b2-a78b-278819a56d76 req-a730b725-de2e-412f-b8cb-a6f866d480f6 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0732918 Jun 17 11:04:01.883511 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8d74aa15-68f2-43b2-a78b-278819a56d76 req-7536d0bb-18b4-401f-b18c-0de20fd8fe07 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317087 Jun 17 11:04:02.112971 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f089dc4b-6ca0-440c-b87b-97f2c2d53e4a req-48e1b44d-d2f6-4e0e-8c7d-f5bd204806b1 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:02.114433 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f089dc4b-6ca0-440c-b87b-97f2c2d53e4a req-48e1b44d-d2f6-4e0e-8c7d-f5bd204806b1 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0663495 Jun 17 11:04:02.154644 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f089dc4b-6ca0-440c-b87b-97f2c2d53e4a req-d6a5ada1-e091-4ef9-b603-0ef867504126 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336463 Jun 17 11:04:02.281529 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-897d91e6-c5bc-4d72-b22f-05e36edf7f11 req-f04f1bae-8874-43ff-9cd1-a72d88c51a8b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:02.283785 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-897d91e6-c5bc-4d72-b22f-05e36edf7f11 req-f04f1bae-8874-43ff-9cd1-a72d88c51a8b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0752091 Jun 17 11:04:02.333125 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-897d91e6-c5bc-4d72-b22f-05e36edf7f11 req-c9181d7f-3eb9-4148-a433-d2efeeb4d7c2 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406857 Jun 17 11:04:02.448708 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 37952) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:02.462251 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1cf967eb-498f-4f90-8616-1db936e2533b admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:02.553942 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1cf967eb-498f-4f90-8616-1db936e2533b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:02.657166 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1cf967eb-498f-4f90-8616-1db936e2533b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:02.661853 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-7fb3818c-3c2f-4f2d-8c7f-c1292c6e0089 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:02.699296 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-1cf967eb-498f-4f90-8616-1db936e2533b admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=ee5c4025d3654f7a990170e8aa0d4c7e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2493792 Jun 17 11:04:02.700195 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf967eb-498f-4f90-8616-1db936e2533b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3973997a-ee06-4279-bbe2-b3802b208f79,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:02.702903 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 37956) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:02.703490 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-1cf967eb-498f-4f90-8616-1db936e2533b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:02.761409 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8b1c4d00-3de4-49c4-b741-cba4c67dcc67 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:02.784709 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8b1c4d00-3de4-49c4-b741-cba4c67dcc67 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:02.902444 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8b1c4d00-3de4-49c4-b741-cba4c67dcc67 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:02.904984 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8b1c4d00-3de4-49c4-b741-cba4c67dcc67 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:02.906103 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-8b1c4d00-3de4-49c4-b741-cba4c67dcc67 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/3973997a-ee06-4279-bbe2-b3802b208f79 HTTP/1.1" status: 204 len: 168 time: 0.2016623 Jun 17 11:04:02.906884 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5cc1bdf4-52c7-4ce2-ba1a-8df68b8dde93 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:02.914564 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b1c4d00-3de4-49c4-b741-cba4c67dcc67 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3973997a-ee06-4279-bbe2-b3802b208f79,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:02.918436 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8b1c4d00-3de4-49c4-b741-cba4c67dcc67 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:03.073315 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01e4fea0-5679-4182-829b-d09f71419290 req-03fc0684-90ac-4c65-a8e8-d3e279b17bf2 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:03.074885 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-01e4fea0-5679-4182-829b-d09f71419290 req-03fc0684-90ac-4c65-a8e8-d3e279b17bf2 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0751767 Jun 17 11:04:03.118953 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-01e4fea0-5679-4182-829b-d09f71419290 req-78c93035-c538-4a94-89e2-b8651b11f470 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383348 Jun 17 11:04:03.374212 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a814068c-eb9e-4db1-9f69-982db2734e85 req-a6c56873-0bcc-4410-9130-3cb985333142 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:03.384527 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a814068c-eb9e-4db1-9f69-982db2734e85 req-a6c56873-0bcc-4410-9130-3cb985333142 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0816262 Jun 17 11:04:03.445960 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a814068c-eb9e-4db1-9f69-982db2734e85 req-827521f5-c099-4f45-9235-1556f5e340c4 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545166 Jun 17 11:04:03.535992 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad175f00-d158-448e-b016-e54113d4bb9f req-09873cc6-c1f4-4284-a36f-4959441e4554 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:03.541655 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ad175f00-d158-448e-b016-e54113d4bb9f req-09873cc6-c1f4-4284-a36f-4959441e4554 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0852323 Jun 17 11:04:03.577252 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ad175f00-d158-448e-b016-e54113d4bb9f req-1a8bfcb5-e2c8-44a0-b5bd-6d9b372b91fe tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340364 Jun 17 11:04:04.333250 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9b05deb-0828-4509-96f3-830456879072 req-0dc6e135-3155-4451-ad75-24b4c4255ebc tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:04.334720 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a9b05deb-0828-4509-96f3-830456879072 req-0dc6e135-3155-4451-ad75-24b4c4255ebc tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0783739 Jun 17 11:04:04.380037 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a9b05deb-0828-4509-96f3-830456879072 req-9f35d15e-ba23-442d-8428-b3bfa11908c3 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0370157 Jun 17 11:04:04.645579 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9a380b4-bdb6-42ba-b390-3e79d91c0317 req-41f6a1d8-d083-4426-9b13-239472a1872e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:04.648777 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b9a380b4-bdb6-42ba-b390-3e79d91c0317 req-41f6a1d8-d083-4426-9b13-239472a1872e tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0750153 Jun 17 11:04:04.695100 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b9a380b4-bdb6-42ba-b390-3e79d91c0317 req-cb06233b-a317-4b31-bafc-1bfadec812ef tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404510 Jun 17 11:04:04.776025 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ca7f83-2451-4079-a6b3-6ca524999805 req-f3be0372-1840-4a66-aa66-aeb6140775a4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:04.778423 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79ca7f83-2451-4079-a6b3-6ca524999805 req-f3be0372-1840-4a66-aa66-aeb6140775a4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0693183 Jun 17 11:04:04.818077 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79ca7f83-2451-4079-a6b3-6ca524999805 req-1b4c9f24-4e1c-4f45-864a-1fa55f7a4997 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318265 Jun 17 11:04:04.997746 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38018) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:05.110311 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:05.215829 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:05.297557 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:05.300978 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-91f6cfe0-c5fa-42ac-b539-c6cf4b708e88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:05.339999 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=989ef6954d374e9eabc9cdd9e5a649ca&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3410258 Jun 17 11:04:05.341078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3599c2d4-4ba9-4a1d-86ca-a85496f6bf05,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:05.342979 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 38024) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:05.359264 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.364078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.364078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.364078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.364078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.364078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.364078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.364078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.364078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.364078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.364078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.364078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:05.368113 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:05.429251 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-645351e8-8f9a-4e74-9648-e4110474b92b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:05.458676 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-645351e8-8f9a-4e74-9648-e4110474b92b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:05.590714 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c4a5cf-67bc-42fc-a012-ebb4d574d943 req-21176535-fe17-4b7f-a3c3-6a364bf44411 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:05.592141 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-06c4a5cf-67bc-42fc-a012-ebb4d574d943 req-21176535-fe17-4b7f-a3c3-6a364bf44411 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0672114 Jun 17 11:04:05.616715 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-645351e8-8f9a-4e74-9648-e4110474b92b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:05.619506 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-645351e8-8f9a-4e74-9648-e4110474b92b admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:05.620647 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-645351e8-8f9a-4e74-9648-e4110474b92b admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/3599c2d4-4ba9-4a1d-86ca-a85496f6bf05 HTTP/1.1" status: 204 len: 168 time: 0.2758760 Jun 17 11:04:05.621534 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4525e471-9ac4-407d-bffb-fae2d93022be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:05.630083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-645351e8-8f9a-4e74-9648-e4110474b92b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3599c2d4-4ba9-4a1d-86ca-a85496f6bf05,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:05.632415 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-645351e8-8f9a-4e74-9648-e4110474b92b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:05.648353 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-06c4a5cf-67bc-42fc-a012-ebb4d574d943 req-2d6a7586-f070-4ba0-a15c-e25724c2a0e6 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0500340 Jun 17 11:04:05.877236 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb08bd1-0b97-4443-909a-98bf59f8fed1 req-9a43d3d6-9061-4617-b236-580e9a4619f9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:05.879611 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-eeb08bd1-0b97-4443-909a-98bf59f8fed1 req-9a43d3d6-9061-4617-b236-580e9a4619f9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0690830 Jun 17 11:04:05.922886 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-eeb08bd1-0b97-4443-909a-98bf59f8fed1 req-a95226e4-49d2-4ac1-9bd2-342a25a27ea2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369825 Jun 17 11:04:05.996963 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68835324-a73a-4492-93cd-ab47fc16ad4a req-5f10902f-b53b-45ee-9330-e4a1d112ffba tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:05.998431 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-68835324-a73a-4492-93cd-ab47fc16ad4a req-5f10902f-b53b-45ee-9330-e4a1d112ffba tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0643179 Jun 17 11:04:06.042621 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-68835324-a73a-4492-93cd-ab47fc16ad4a req-e605314e-3e83-470c-ba35-e764ee0b9372 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369778 Jun 17 11:04:06.049350 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:04:06.934395 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58868e8-b050-44a2-9536-668f15872a6e req-91f4420e-443a-4c10-9585-e9c8bfc2be57 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:06.941495 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f58868e8-b050-44a2-9536-668f15872a6e req-91f4420e-443a-4c10-9585-e9c8bfc2be57 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.1327381 Jun 17 11:04:07.005509 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f58868e8-b050-44a2-9536-668f15872a6e req-672ab1bb-700b-4142-aa07-d534493539f0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491242 Jun 17 11:04:07.111733 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74af0f71-c8ad-465b-ac77-0bbd78498c47 req-b650ebd5-f0dc-464e-94bb-3568e6f1ffb8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:07.113485 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-74af0f71-c8ad-465b-ac77-0bbd78498c47 req-b650ebd5-f0dc-464e-94bb-3568e6f1ffb8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0639157 Jun 17 11:04:07.153477 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-74af0f71-c8ad-465b-ac77-0bbd78498c47 req-f6d746ec-c30e-4f50-b725-636cee9220c9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334949 Jun 17 11:04:07.241899 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afccfe75-98b4-4433-849d-8c81cda81c72 req-a6911ae2-2c50-4d3e-8f6b-337799e6eb0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:07.243657 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-afccfe75-98b4-4433-849d-8c81cda81c72 req-a6911ae2-2c50-4d3e-8f6b-337799e6eb0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0712466 Jun 17 11:04:07.268116 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:07.288888 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-afccfe75-98b4-4433-849d-8c81cda81c72 req-d4ce1ac8-4038-4796-acb7-2c0cc486f9c2 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396416 Jun 17 11:04:08.212619 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a4c7ed0-8390-44be-b60e-c9fbb2944eb4 req-9dd546c2-1897-4eb8-85e8-90ed54352e3a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:08.214239 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3a4c7ed0-8390-44be-b60e-c9fbb2944eb4 req-9dd546c2-1897-4eb8-85e8-90ed54352e3a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0748899 Jun 17 11:04:08.252958 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3a4c7ed0-8390-44be-b60e-c9fbb2944eb4 req-5256b68f-fd06-46f6-8a20-b52d0509f919 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0328774 Jun 17 11:04:08.389839 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-158c732a-59e2-4b37-b561-a6e802944795 req-bdb911d6-6e9b-48c4-b17b-b4fe25ba048b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:08.392013 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-158c732a-59e2-4b37-b561-a6e802944795 req-bdb911d6-6e9b-48c4-b17b-b4fe25ba048b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0960715 Jun 17 11:04:08.439638 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-158c732a-59e2-4b37-b561-a6e802944795 req-3fa069ca-4fb2-4b33-a6e6-a08a4bcacb78 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411270 Jun 17 11:04:08.485472 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d5d0ad7-58c0-4519-ba59-b58e8291c407 req-e72d4b46-1a04-4671-82f9-3175e79fa4a2 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:08.486995 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5d5d0ad7-58c0-4519-ba59-b58e8291c407 req-e72d4b46-1a04-4671-82f9-3175e79fa4a2 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0673597 Jun 17 11:04:08.527796 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5d5d0ad7-58c0-4519-ba59-b58e8291c407 req-34d4ad2b-3665-489b-9585-75b2408ce2c0 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0345297 Jun 17 11:04:09.441523 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b59d0893-9fc6-4e02-ad07-dc8ea9d84c3a req-70f00962-4636-4615-b567-eb86aec37051 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:09.443126 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b59d0893-9fc6-4e02-ad07-dc8ea9d84c3a req-70f00962-4636-4615-b567-eb86aec37051 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0713630 Jun 17 11:04:09.487143 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b59d0893-9fc6-4e02-ad07-dc8ea9d84c3a req-9f5985e9-bee3-41af-b9b3-04dc020120f1 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380514 Jun 17 11:04:09.653475 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4bf90a-9e4b-42e2-9e9a-c02e6d7021f7 req-62262d4e-9db5-4223-99fa-ea0e594c4deb tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:09.660768 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6c4bf90a-9e4b-42e2-9e9a-c02e6d7021f7 req-62262d4e-9db5-4223-99fa-ea0e594c4deb tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0891316 Jun 17 11:04:09.705104 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6c4bf90a-9e4b-42e2-9e9a-c02e6d7021f7 req-bc4a70aa-2a80-47c2-8c3a-33f4f2b2e808 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433745 Jun 17 11:04:09.735715 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0170e6af-d29e-490f-8676-2d7986ae62b4 req-ef5270c7-70ce-417a-b912-c2c4560d9e86 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:09.737274 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0170e6af-d29e-490f-8676-2d7986ae62b4 req-ef5270c7-70ce-417a-b912-c2c4560d9e86 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0798900 Jun 17 11:04:09.795862 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0170e6af-d29e-490f-8676-2d7986ae62b4 req-9c452fb2-6fc5-4622-9064-533c294e06d6 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448887 Jun 17 11:04:10.861021 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a9479b-7c99-4b97-839c-37c957911c87 req-59142677-d3da-4b9f-a4fc-9f619da45dd4 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:10.862725 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c4a9479b-7c99-4b97-839c-37c957911c87 req-59142677-d3da-4b9f-a4fc-9f619da45dd4 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.2630446 Jun 17 11:04:10.880388 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19a8844a-1bab-4953-95fc-a33ba0b0e1b9 req-34006a07-85aa-45bc-921b-2ee322146ba2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:10.881896 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-19a8844a-1bab-4953-95fc-a33ba0b0e1b9 req-34006a07-85aa-45bc-921b-2ee322146ba2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0669315 Jun 17 11:04:10.907011 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c4a9479b-7c99-4b97-839c-37c957911c87 req-45f721d4-961d-4f0f-b8ab-06d28dad8719 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382707 Jun 17 11:04:10.919779 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-19a8844a-1bab-4953-95fc-a33ba0b0e1b9 req-10a96642-7de4-4eca-8d2e-9713f0cb7bd3 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320125 Jun 17 11:04:11.069732 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-747b0fec-b8a1-4359-988f-dbfc67f0e12a req-a2c65d4a-a7d3-44da-82e1-d2493118cd0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:11.071203 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-747b0fec-b8a1-4359-988f-dbfc67f0e12a req-a2c65d4a-a7d3-44da-82e1-d2493118cd0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0616667 Jun 17 11:04:11.106810 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-747b0fec-b8a1-4359-988f-dbfc67f0e12a req-17db7795-12f5-4ea5-a645-817046db9d1d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0300074 Jun 17 11:04:12.088025 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3892c06c-ee42-4a17-8059-4d202a0a9632 req-a75d7651-1c4c-45f3-b3ba-940c8cc0008b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:12.089491 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3892c06c-ee42-4a17-8059-4d202a0a9632 req-a75d7651-1c4c-45f3-b3ba-940c8cc0008b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0680017 Jun 17 11:04:12.093840 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272c6d4d-e951-4b39-a17c-2b907ad1c5a6 req-1ee8c6c8-f09e-41e4-9ae5-f9f46f1fb106 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:12.095311 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-272c6d4d-e951-4b39-a17c-2b907ad1c5a6 req-1ee8c6c8-f09e-41e4-9ae5-f9f46f1fb106 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0643260 Jun 17 11:04:12.130101 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3892c06c-ee42-4a17-8059-4d202a0a9632 req-c009626c-92fb-4cfb-8ff6-7a86d955c94f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0348985 Jun 17 11:04:12.137767 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-272c6d4d-e951-4b39-a17c-2b907ad1c5a6 req-aac9f344-dba1-45d5-9649-f1a9f365ebb8 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361578 Jun 17 11:04:12.290937 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e47646f-5598-44a1-8333-e23c3b2b4b14 req-b182f9a8-8dd5-4216-b0e8-c9c06b7ec009 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:12.292322 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5e47646f-5598-44a1-8333-e23c3b2b4b14 req-b182f9a8-8dd5-4216-b0e8-c9c06b7ec009 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0629842 Jun 17 11:04:12.329680 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5e47646f-5598-44a1-8333-e23c3b2b4b14 req-7a677af9-5503-4d35-a37e-605338fd338e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318203 Jun 17 11:04:12.613376 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0597963-6a12-429d-9b0a-42e285d7e1bd req-1814cae6-65e4-4418-aa5c-acdaf76f9402 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:12.614886 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d0597963-6a12-429d-9b0a-42e285d7e1bd req-1814cae6-65e4-4418-aa5c-acdaf76f9402 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ed69cf6aa40941c48c25effb0c1af8fc&device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 1097 time: 0.0579596 Jun 17 11:04:12.730578 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0597963-6a12-429d-9b0a-42e285d7e1bd req-aeb2380c-7b73-4d1f-9cdc-7428f38c6c8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:12.732065 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d0597963-6a12-429d-9b0a-42e285d7e1bd req-aeb2380c-7b73-4d1f-9cdc-7428f38c6c8e service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=ed69cf6aa40941c48c25effb0c1af8fc&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0999215 Jun 17 11:04:12.831895 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0597963-6a12-429d-9b0a-42e285d7e1bd req-5aebc268-9f32-4825-b443-29cc44788f3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:12.833375 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d0597963-6a12-429d-9b0a-42e285d7e1bd req-5aebc268-9f32-4825-b443-29cc44788f3c service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0948937 Jun 17 11:04:12.951429 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-99dc679d-3416-44e4-8832-e020ab7f0c3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:12.952909 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-99dc679d-3416-44e4-8832-e020ab7f0c3e service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ed69cf6aa40941c48c25effb0c1af8fc&device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 1097 time: 0.0534556 Jun 17 11:04:12.996079 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-fc13f589-de7b-45cf-a4d3-6c98c165924a service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 HTTP/1.1" status: 200 len: 217 time: 0.0348692 Jun 17 11:04:13.048296 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-c9dce997-b4ef-44e5-853e-0edb5e14f2a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:13.049893 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-c9dce997-b4ef-44e5-853e-0edb5e14f2a9 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=5d332463-1c62-46e2-a7e3-4b587a2e5f1e HTTP/1.1" status: 200 len: 854 time: 0.0474954 Jun 17 11:04:13.110341 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-22b10bb3-6a40-4881-aaf5-aa9ffd04c0d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:13.111886 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-22b10bb3-6a40-4881-aaf5-aa9ffd04c0d0 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=aeced3ed-7670-4043-a385-87de6f75150b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0557296 Jun 17 11:04:13.207662 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-58391644-b32e-49a1-99ae-f2fe5b29ac2d service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0885618 Jun 17 11:04:13.316180 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54fdf653-bab3-411c-993f-90ed96ec6038 req-79ecef95-d7d2-42c0-ac84-1fd4547abb7a service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1007490 Jun 17 11:04:13.319507 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841a0e70-68b7-443a-81b4-a9a624ca2b22 req-a013d009-53d7-49dd-9232-958fe979e06b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:13.321056 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-841a0e70-68b7-443a-81b4-a9a624ca2b22 req-a013d009-53d7-49dd-9232-958fe979e06b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0733483 Jun 17 11:04:13.362047 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-841a0e70-68b7-443a-81b4-a9a624ca2b22 req-f5afc1b7-7bd7-4f3d-9cbf-b9de5b5ac6ba tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0353856 Jun 17 11:04:13.410161 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a522f67f-c879-4a68-ab7e-942eb3cba858 req-d39c930b-b5fd-4880-abcc-2351428b20db tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:13.411732 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a522f67f-c879-4a68-ab7e-942eb3cba858 req-d39c930b-b5fd-4880-abcc-2351428b20db tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.1309652 Jun 17 11:04:13.454953 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a522f67f-c879-4a68-ab7e-942eb3cba858 req-31ee2db7-7f53-4184-8884-5dd276eac264 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366933 Jun 17 11:04:13.545610 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c434573-f71c-472b-8172-6839ac322c34 req-8a2ba520-8f11-4ac7-900c-355b7082cc41 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:13.547172 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0c434573-f71c-472b-8172-6839ac322c34 req-8a2ba520-8f11-4ac7-900c-355b7082cc41 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0758510 Jun 17 11:04:13.587464 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0c434573-f71c-472b-8172-6839ac322c34 req-ab883599-45f7-4451-adc8-1865e3410f19 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332365 Jun 17 11:04:13.918055 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a841eed-b68b-4a74-945e-fd7901cd261c req-95ba5804-e25c-4e21-970d-93bc26549f24 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:13.919374 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2a841eed-b68b-4a74-945e-fd7901cd261c req-95ba5804-e25c-4e21-970d-93bc26549f24 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0706186 Jun 17 11:04:13.960168 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2a841eed-b68b-4a74-945e-fd7901cd261c req-f3f3ee8a-4423-4883-83e6-0aced82ed731 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0335708 Jun 17 11:04:14.000795 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7baf3f4c-d65c-478a-9621-d28757627897 req-d9fae1a9-03e3-4d1a-ae9e-51c327923030 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:14.002274 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7baf3f4c-d65c-478a-9621-d28757627897 req-d9fae1a9-03e3-4d1a-ae9e-51c327923030 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 1098 time: 0.0611145 Jun 17 11:04:14.095878 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7baf3f4c-d65c-478a-9621-d28757627897 req-4e2827fa-ad37-475d-a3d3-b533ee0d4feb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:14.097999 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7baf3f4c-d65c-478a-9621-d28757627897 req-4e2827fa-ad37-475d-a3d3-b533ee0d4feb service neutron] 10.222.0.25 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 911 time: 0.0887072 Jun 17 11:04:14.169067 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7baf3f4c-d65c-478a-9621-d28757627897 req-19d89560-1b14-4f9d-ade7-be67345ee761 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=584d5dfc-3f46-4820-80b2-e729ce075654 HTTP/1.1" status: 200 len: 1000 time: 0.0640423 Jun 17 11:04:14.221280 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7baf3f4c-d65c-478a-9621-d28757627897 req-0e63872b-3ab8-4794-931d-4b6deb375d6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:14.221280 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7baf3f4c-d65c-478a-9621-d28757627897 req-0e63872b-3ab8-4794-931d-4b6deb375d6a service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 200 len: 849 time: 0.0444202 Jun 17 11:04:14.278665 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7baf3f4c-d65c-478a-9621-d28757627897 req-c1b1070a-9629-4616-aed7-3d68fbed8750 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:14.284095 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7baf3f4c-d65c-478a-9621-d28757627897 req-c1b1070a-9629-4616-aed7-3d68fbed8750 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=54973ccd-0b2b-4517-ad28-76a3128a2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0525346 Jun 17 11:04:14.374364 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7baf3f4c-d65c-478a-9621-d28757627897 req-d24aa072-db52-41a9-8e0c-c98325d42a4e service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868361 Jun 17 11:04:14.469128 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7baf3f4c-d65c-478a-9621-d28757627897 req-1e0467ae-995d-4af7-ad60-c64ae678dafd service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872881 Jun 17 11:04:14.638517 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f280b9-9de6-4dfe-bc01-ab6dab63863f req-a61bf319-5597-435b-a3d5-da51561da66b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:14.639963 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44f280b9-9de6-4dfe-bc01-ab6dab63863f req-a61bf319-5597-435b-a3d5-da51561da66b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0688612 Jun 17 11:04:14.687547 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44f280b9-9de6-4dfe-bc01-ab6dab63863f req-26a3eb6a-6349-4039-a261-f9874339bbad tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414577 Jun 17 11:04:14.773585 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c08336d-1d6e-4551-bf66-9b7b30803462 req-a0e5fc3e-6a7e-4973-bef8-3b0325a17186 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:14.774900 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2c08336d-1d6e-4551-bf66-9b7b30803462 req-a0e5fc3e-6a7e-4973-bef8-3b0325a17186 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0644453 Jun 17 11:04:14.817445 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2c08336d-1d6e-4551-bf66-9b7b30803462 req-756a5fc7-fb24-4238-a0a0-9b2d9c990e0a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358865 Jun 17 11:04:15.140129 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e4648f0-2e1a-4948-832e-981d821ec0cc req-e41d0cc7-f7c9-412c-a70f-2115349bc06c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:15.141581 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7e4648f0-2e1a-4948-832e-981d821ec0cc req-e41d0cc7-f7c9-412c-a70f-2115349bc06c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0633616 Jun 17 11:04:15.179538 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7e4648f0-2e1a-4948-832e-981d821ec0cc req-cc4c5df3-480b-42e7-b935-fa9338eb42b1 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316191 Jun 17 11:04:15.862085 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c07366fe-9a38-4021-81c5-78141a0c94df req-fc6950bb-0d04-4e7a-ae3c-eebb4394bbec tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:15.864462 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c07366fe-9a38-4021-81c5-78141a0c94df req-fc6950bb-0d04-4e7a-ae3c-eebb4394bbec tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0664380 Jun 17 11:04:15.902819 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c07366fe-9a38-4021-81c5-78141a0c94df req-25172dcc-d5ab-40ee-b374-8cb96c9acb01 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325677 Jun 17 11:04:15.990710 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9faf4315-13f4-4b43-95be-21a597736c5c req-cab1ccbf-098b-40de-9d8a-e29f5e3d7582 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:15.991406 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9faf4315-13f4-4b43-95be-21a597736c5c req-cab1ccbf-098b-40de-9d8a-e29f5e3d7582 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0619123 Jun 17 11:04:16.030036 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9faf4315-13f4-4b43-95be-21a597736c5c req-3485f27a-da79-44b4-b19c-584a904512e6 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323379 Jun 17 11:04:16.355459 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cad82d0-38ce-4d61-bcf0-4a3b029f15b2 req-973baa22-6bc9-4de4-917c-c0886fbccd42 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:16.356921 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5cad82d0-38ce-4d61-bcf0-4a3b029f15b2 req-973baa22-6bc9-4de4-917c-c0886fbccd42 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0654278 Jun 17 11:04:16.396058 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5cad82d0-38ce-4d61-bcf0-4a3b029f15b2 req-c5c3a02d-21d8-4836-8e8b-6f2f29ec9a05 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0332558 Jun 17 11:04:17.083326 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f3a1b6-29bd-4fc2-9bc7-5508814f20ed req-11cb6ddc-1881-4647-b138-07dbaa336aad tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:17.084922 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-37f3a1b6-29bd-4fc2-9bc7-5508814f20ed req-11cb6ddc-1881-4647-b138-07dbaa336aad tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0666842 Jun 17 11:04:17.122779 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-37f3a1b6-29bd-4fc2-9bc7-5508814f20ed req-a6260598-8fb1-42f3-bd88-949da04a1b93 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318418 Jun 17 11:04:17.213317 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1e7acce-bb48-49a4-b2ef-717f489d9a8f req-229931c5-9aa8-4788-84b4-0956a8db0e87 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:17.214816 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c1e7acce-bb48-49a4-b2ef-717f489d9a8f req-229931c5-9aa8-4788-84b4-0956a8db0e87 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0640786 Jun 17 11:04:17.254036 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c1e7acce-bb48-49a4-b2ef-717f489d9a8f req-bb6ae33d-a1a3-47d6-8f76-0b689152ad9e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333230 Jun 17 11:04:17.564394 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d7d2ae-34be-4c65-85b9-6eacb931e3fb req-e7f9305c-d41a-403c-80e1-5eec7f09b2bd tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:17.565797 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-24d7d2ae-34be-4c65-85b9-6eacb931e3fb req-e7f9305c-d41a-403c-80e1-5eec7f09b2bd tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0611057 Jun 17 11:04:17.602070 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-24d7d2ae-34be-4c65-85b9-6eacb931e3fb req-d831fa9b-0d14-4e2a-ad12-7efba319ffbc tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0305610 Jun 17 11:04:18.297768 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62dbd306-6774-4b92-bf44-e0c623c9dcdc req-47511d96-e810-4794-b6c0-750b3daebfe7 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:18.299261 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-62dbd306-6774-4b92-bf44-e0c623c9dcdc req-47511d96-e810-4794-b6c0-750b3daebfe7 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0680399 Jun 17 11:04:18.337393 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-62dbd306-6774-4b92-bf44-e0c623c9dcdc req-2d984bdc-51c8-41cb-a4be-3e396a4e6954 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324197 Jun 17 11:04:18.430659 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e328ae7f-66d5-4b7e-af21-86be275416f2 req-d9f57d5b-3921-4a49-97bc-cdbf2282d0da tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:18.432167 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e328ae7f-66d5-4b7e-af21-86be275416f2 req-d9f57d5b-3921-4a49-97bc-cdbf2282d0da tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0663564 Jun 17 11:04:18.469650 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e328ae7f-66d5-4b7e-af21-86be275416f2 req-d4fc2afd-7bd9-4b1e-a407-c03b9eccf1d8 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313542 Jun 17 11:04:18.776168 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b66e060f-5120-48bb-8ba3-4aa6a12def83 req-e91d1279-cf39-4a9e-bc8e-713c125d05a8 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:18.777676 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b66e060f-5120-48bb-8ba3-4aa6a12def83 req-e91d1279-cf39-4a9e-bc8e-713c125d05a8 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0637600 Jun 17 11:04:18.814969 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b66e060f-5120-48bb-8ba3-4aa6a12def83 req-fb13a793-eb1c-4b0f-912f-985b7c2186d5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316703 Jun 17 11:04:19.510173 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3057bbc5-3925-4cb6-a04d-3a189fecba20 req-3828922c-60ee-4583-b2ca-fe64edb492e6 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:19.511704 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3057bbc5-3925-4cb6-a04d-3a189fecba20 req-3828922c-60ee-4583-b2ca-fe64edb492e6 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0621760 Jun 17 11:04:19.548753 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3057bbc5-3925-4cb6-a04d-3a189fecba20 req-aeeb4919-0323-4578-b061-5f3494d1d327 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313835 Jun 17 11:04:19.637942 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec7d2771-c1ba-4e9d-a2dc-78e882c211fc req-55253fd9-32e7-4d83-91e8-ee45c9560329 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:19.639358 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ec7d2771-c1ba-4e9d-a2dc-78e882c211fc req-55253fd9-32e7-4d83-91e8-ee45c9560329 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0601041 Jun 17 11:04:19.678422 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ec7d2771-c1ba-4e9d-a2dc-78e882c211fc req-e7d8d7fa-fb32-434e-8f98-e3bbd557ff89 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327744 Jun 17 11:04:20.086406 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e594b8-4d31-4759-bb13-2825f3fae71a req-dbdfcce4-1dc2-4900-b68c-516bf50f4751 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:20.087886 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-65e594b8-4d31-4759-bb13-2825f3fae71a req-dbdfcce4-1dc2-4900-b68c-516bf50f4751 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0614631 Jun 17 11:04:20.129132 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-65e594b8-4d31-4759-bb13-2825f3fae71a req-9ac42305-f295-4922-93cc-f060319adbe8 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0352197 Jun 17 11:04:20.508354 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60215cef-d9f0-4cec-8e0e-21642c6cdc7b req-93f37de9-0caa-4123-9c2e-cb2c54e8bfd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:20.509690 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-60215cef-d9f0-4cec-8e0e-21642c6cdc7b req-93f37de9-0caa-4123-9c2e-cb2c54e8bfd8 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 1098 time: 0.0544028 Jun 17 11:04:20.543896 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-60215cef-d9f0-4cec-8e0e-21642c6cdc7b req-e1da55d7-40a6-4f20-a80e-cb63491a5b06 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0276055 Jun 17 11:04:20.668214 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-66cbe6c0-dbb2-4588-a9ce-16882a9b034f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:20.730712 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-095489d3-ed66-4d40-89c6-6582c4b39bc1 req-602afcfb-a0f3-470e-9aaf-ce9458a45377 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:20.733528 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-095489d3-ed66-4d40-89c6-6582c4b39bc1 req-602afcfb-a0f3-470e-9aaf-ce9458a45377 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0705755 Jun 17 11:04:20.772261 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-095489d3-ed66-4d40-89c6-6582c4b39bc1 req-64bed94a-bfc5-43a6-baf1-921196c4d032 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341833 Jun 17 11:04:20.852613 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6adccedb-f7d6-4516-bf6d-0bfb44ee260f req-82e5f8ba-3f4c-4607-9cf7-78861b48bcd7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:20.854078 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6adccedb-f7d6-4516-bf6d-0bfb44ee260f req-82e5f8ba-3f4c-4607-9cf7-78861b48bcd7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0645595 Jun 17 11:04:20.893254 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6adccedb-f7d6-4516-bf6d-0bfb44ee260f req-acc3460f-7131-47b3-978d-3b480c9da34c tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334427 Jun 17 11:04:21.313026 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5008f5cb-4417-48c6-a6f9-a4e192703e8b req-f4ed8322-e375-46cd-81e1-6566a66d8dc1 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:21.314606 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5008f5cb-4417-48c6-a6f9-a4e192703e8b req-f4ed8322-e375-46cd-81e1-6566a66d8dc1 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0657122 Jun 17 11:04:21.355417 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5008f5cb-4417-48c6-a6f9-a4e192703e8b req-cd6fe460-53d0-4374-aedb-8243cc7cc31e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343692 Jun 17 11:04:21.966652 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8adfd9fa-96c3-4c91-ae3d-630dcc950682 req-ff8bf360-2d1d-48b1-8bd7-adbdc286b50c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:21.968048 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8adfd9fa-96c3-4c91-ae3d-630dcc950682 req-ff8bf360-2d1d-48b1-8bd7-adbdc286b50c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0781913 Jun 17 11:04:22.006742 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8adfd9fa-96c3-4c91-ae3d-630dcc950682 req-2751a0a0-f57a-45f0-81cd-0e5e9cdc7abc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323176 Jun 17 11:04:22.071965 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4457d5f3-d03f-4fc7-a2bf-36bc7b2a6f37 req-70b57035-6ae6-4dbd-b64c-0d158b78efc1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:22.073404 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4457d5f3-d03f-4fc7-a2bf-36bc7b2a6f37 req-70b57035-6ae6-4dbd-b64c-0d158b78efc1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 944 time: 0.0666134 Jun 17 11:04:22.114631 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4457d5f3-d03f-4fc7-a2bf-36bc7b2a6f37 req-2227bd74-4780-4f1e-9157-84b6de3836c5 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355034 Jun 17 11:04:22.322175 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:04:22.415119 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:04:22.427046 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'port_id': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'mac_address': 'fa:16:3e:41:26:95', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 143, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:04:22.469912 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:22.486139 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:04:22.504096 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:04:22.582157 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:22.583966 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:22.629555 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:22.636644 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.636992 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.637331 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.637673 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.638019 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.638349 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.638674 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.639034 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.639365 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.639682 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.640000 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.640321 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:22.644105 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:22.988897 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:04:23.184910 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9d2d4d2-cebd-4c51-8f3e-a1ab99f92cc2 req-6f4c1bfd-a4fa-464f-a85f-b61288e0d37a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:23.187512 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d9d2d4d2-cebd-4c51-8f3e-a1ab99f92cc2 req-6f4c1bfd-a4fa-464f-a85f-b61288e0d37a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0657785 Jun 17 11:04:23.228366 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d9d2d4d2-cebd-4c51-8f3e-a1ab99f92cc2 req-6faf8e09-84e8-4a73-aaa5-9d12ccee0d0f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0363185 Jun 17 11:04:23.300964 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41f25888-abdd-4564-8e2d-b3fd6e3600c3 req-e9e191f3-60f5-4304-8759-7f10953ee126 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:23.302474 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-41f25888-abdd-4564-8e2d-b3fd6e3600c3 req-e9e191f3-60f5-4304-8759-7f10953ee126 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 945 time: 0.0699883 Jun 17 11:04:23.341266 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-41f25888-abdd-4564-8e2d-b3fd6e3600c3 req-005d7288-d2c2-4176-923b-95cd125de792 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329466 Jun 17 11:04:23.388137 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d547a5ca-3771-4fe4-a24a-8127a8c83218 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:23.582720 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:23.974894 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b26428f3-3bf9-4844-bf54-8a69fe4547c2 req-6af92d47-1840-40b3-96ce-488e01676b02 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:23.977061 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b26428f3-3bf9-4844-bf54-8a69fe4547c2 req-6af92d47-1840-40b3-96ce-488e01676b02 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0830247 Jun 17 11:04:24.005992 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c851209f-be9c-4ff4-9ee1-da391c7efde2 req-6fb4901b-203a-4cee-b586-10f0dc0e2ebc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:24.008246 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c851209f-be9c-4ff4-9ee1-da391c7efde2 req-6fb4901b-203a-4cee-b586-10f0dc0e2ebc service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 1098 time: 0.0651848 Jun 17 11:04:24.032381 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b26428f3-3bf9-4844-bf54-8a69fe4547c2 req-24f19c97-72d3-48a7-a6eb-db3ae43499cb tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479136 Jun 17 11:04:24.117550 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c851209f-be9c-4ff4-9ee1-da391c7efde2 req-cf3143f0-dc6a-414a-a6f9-dd335be908bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:24.119101 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c851209f-be9c-4ff4-9ee1-da391c7efde2 req-cf3143f0-dc6a-414a-a6f9-dd335be908bf service neutron] 10.222.0.25 "GET /v2.0/networks?id=0fe823e2-06dd-4212-84a6-8e0beda57580 HTTP/1.1" status: 200 len: 920 time: 0.0949745 Jun 17 11:04:24.167086 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c851209f-be9c-4ff4-9ee1-da391c7efde2 req-efd7c96e-3a35-4285-bfb2-3636708b5133 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2ec3e896-70d1-4c47-933b-7234e4f744ed HTTP/1.1" status: 200 len: 217 time: 0.0339940 Jun 17 11:04:24.218451 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c851209f-be9c-4ff4-9ee1-da391c7efde2 req-dce01fc1-4581-4274-bdd8-df1a063cec3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:24.220137 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c851209f-be9c-4ff4-9ee1-da391c7efde2 req-dce01fc1-4581-4274-bdd8-df1a063cec3a service neutron] 10.222.0.25 "GET /v2.0/subnets?id=ab7c7a9f-b422-4b40-b94a-6939be91bbb8 HTTP/1.1" status: 200 len: 859 time: 0.0472391 Jun 17 11:04:24.256634 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c851209f-be9c-4ff4-9ee1-da391c7efde2 req-a1da2f52-1034-4d94-9adf-f912149eba26 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0fe823e2-06dd-4212-84a6-8e0beda57580&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0293477 Jun 17 11:04:24.334020 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:04:24.347161 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c851209f-be9c-4ff4-9ee1-da391c7efde2 req-05ff32ef-c3f9-45bf-aed0-480c0ece5b77 service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831749 Jun 17 11:04:24.474621 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:24.548551 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:04:24.553248 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:04:24.553719 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:24.635869 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:24.659039 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:04:24.661925 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6884bbf7-6f38-4fba-8b25-75e281accc7c" -d '{"events": [{"server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "name": "network-vif-plugged", "status": "completed", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:04:24.677850 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:04:24.703084 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:04:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6cd2d7cb-8d33-4ba2-8009-dc9f299ddb5d x-openstack-request-id: req-6cd2d7cb-8d33-4ba2-8009-dc9f299ddb5d {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:04:24.703502 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "name": "network-vif-plugged", "status": "completed", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:04:24.704078 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-6cd2d7cb-8d33-4ba2-8009-dc9f299ddb5d {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:04:24.704448 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'code': 200} Jun 17 11:04:24.732868 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c851209f-be9c-4ff4-9ee1-da391c7efde2 req-366373fc-35b4-471d-84fa-717e0c8336e7 service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3775284 Jun 17 11:04:24.736896 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:24.740801 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:24.757608 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2b48b33-c6ee-4641-af1e-ec1c19736abe req-3ff5feb9-55f1-4e3a-b690-ac10cae2d4c1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:24.758703 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c2b48b33-c6ee-4641-af1e-ec1c19736abe req-3ff5feb9-55f1-4e3a-b690-ac10cae2d4c1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 945 time: 0.1412637 Jun 17 11:04:24.801979 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:24.802783 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c2b48b33-c6ee-4641-af1e-ec1c19736abe req-de0b07b5-b544-4fc8-befc-206ab4d41a92 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381250 Jun 17 11:04:24.805542 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:25.061738 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca741313-c7b8-418a-80c8-804699ff809b req-9a7fc73a-6d21-4fc7-8970-715575c076cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:25.069703 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ca741313-c7b8-418a-80c8-804699ff809b req-9a7fc73a-6d21-4fc7-8970-715575c076cf service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 1099 time: 0.0547583 Jun 17 11:04:25.105201 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ca741313-c7b8-418a-80c8-804699ff809b req-70fb6e81-52d9-4aed-a047-1953ae3dbb4c service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0305483 Jun 17 11:04:25.201838 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac15c47d-388f-4b07-9308-c574a150f002 req-47b689c0-eac4-4b90-8259-7341fed89c44 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:25.203302 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ac15c47d-388f-4b07-9308-c574a150f002 req-47b689c0-eac4-4b90-8259-7341fed89c44 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0638225 Jun 17 11:04:25.240269 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ac15c47d-388f-4b07-9308-c574a150f002 req-2947ead8-2cd9-41f6-a77f-913cfe71eceb tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311723 Jun 17 11:04:25.974080 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e66bd4c1-ea29-4ea7-aa46-ab1cf6133489 req-21eebee7-63f6-4d1e-8922-77b43485bf0f tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:25.975605 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e66bd4c1-ea29-4ea7-aa46-ab1cf6133489 req-21eebee7-63f6-4d1e-8922-77b43485bf0f tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 946 time: 0.0630898 Jun 17 11:04:26.016392 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e66bd4c1-ea29-4ea7-aa46-ab1cf6133489 req-5d4408f3-0523-4a38-9d57-2a34bbe1f7a4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350306 Jun 17 11:04:26.417742 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2d8548-4e82-45da-b2ca-11f9554c6e82 req-92ada0ad-351a-4f96-8c8d-d826f91d3a25 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:26.419390 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-aa2d8548-4e82-45da-b2ca-11f9554c6e82 req-92ada0ad-351a-4f96-8c8d-d826f91d3a25 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0659084 Jun 17 11:04:26.458497 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-aa2d8548-4e82-45da-b2ca-11f9554c6e82 req-b510c96e-3189-44cd-bacf-c257cc8acf95 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329602 Jun 17 11:04:26.769493 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16646e62-87e7-4ff9-93d4-53cc6622cc0c req-17b01023-2320-4044-bbd7-02ef61288430 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:26.770997 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16646e62-87e7-4ff9-93d4-53cc6622cc0c req-17b01023-2320-4044-bbd7-02ef61288430 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0644016 Jun 17 11:04:26.805154 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:26.811272 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-16646e62-87e7-4ff9-93d4-53cc6622cc0c req-549502ea-2008-456f-8bda-394dcb0a6d23 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336745 Jun 17 11:04:27.190116 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b402d24-314b-4820-97d2-094c2a917223 req-bd9221c7-98ea-4332-aa46-d1b10af49a05 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:27.191678 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8b402d24-314b-4820-97d2-094c2a917223 req-bd9221c7-98ea-4332-aa46-d1b10af49a05 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 946 time: 0.0623078 Jun 17 11:04:27.229840 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8b402d24-314b-4820-97d2-094c2a917223 req-abba70ec-25a9-4a6b-a6b3-a7da546de50f tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323377 Jun 17 11:04:27.404810 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ca789f-b606-4768-a627-6c0a82498b75 req-bfaf80ce-f018-4c68-9943-42ee76cda20e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:27.406242 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83ca789f-b606-4768-a627-6c0a82498b75 req-bfaf80ce-f018-4c68-9943-42ee76cda20e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 946 time: 0.0632868 Jun 17 11:04:27.444185 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83ca789f-b606-4768-a627-6c0a82498b75 req-4a3d4a17-de49-405b-8a68-6596068f595d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317509 Jun 17 11:04:27.633922 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05366b8d-9807-4fc4-b7c9-02d041877cad req-da1b0a13-8f97-4b06-8d45-23d7e370d17f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:27.635532 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-05366b8d-9807-4fc4-b7c9-02d041877cad req-da1b0a13-8f97-4b06-8d45-23d7e370d17f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0650842 Jun 17 11:04:27.680442 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-05366b8d-9807-4fc4-b7c9-02d041877cad req-7f01c2c5-5ffe-4f47-86a7-b8d593e3f37a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382323 Jun 17 11:04:27.982507 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f18f737-e83c-456a-bf45-bbff25715f74 req-7207e0b0-3138-4307-9397-75da5b06e3ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:27.983976 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7f18f737-e83c-456a-bf45-bbff25715f74 req-7207e0b0-3138-4307-9397-75da5b06e3ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0629845 Jun 17 11:04:27.987065 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1954fcb0-d014-4f93-aa3f-eb97605f78aa req-7e05b9cd-f5c7-443e-b210-837ee437348a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:27.988518 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1954fcb0-d014-4f93-aa3f-eb97605f78aa req-7e05b9cd-f5c7-443e-b210-837ee437348a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 946 time: 0.0658391 Jun 17 11:04:28.026658 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1954fcb0-d014-4f93-aa3f-eb97605f78aa req-c9af5224-e2e8-4b8d-8ccf-69340ac855eb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326591 Jun 17 11:04:28.027381 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7f18f737-e83c-456a-bf45-bbff25715f74 req-7ac3364f-1467-4399-a1e7-1335feaedb50 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376782 Jun 17 11:04:28.879465 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2da445c8-1df5-4164-8d9e-f7d93cc7e22e req-2294e050-2f58-45d7-9d1a-dc42c9db6be5 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:28.881205 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2da445c8-1df5-4164-8d9e-f7d93cc7e22e req-2294e050-2f58-45d7-9d1a-dc42c9db6be5 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0611427 Jun 17 11:04:28.922185 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2da445c8-1df5-4164-8d9e-f7d93cc7e22e req-5e100d9f-4d4f-494f-b6f7-42affa56616b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349865 Jun 17 11:04:29.197160 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dac37c64-4906-4a26-9e2f-5ea476ca9766 req-26ee5d95-649f-4cde-a2c8-ff1e85d442b9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:29.198561 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-dac37c64-4906-4a26-9e2f-5ea476ca9766 req-26ee5d95-649f-4cde-a2c8-ff1e85d442b9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0616336 Jun 17 11:04:29.236075 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-dac37c64-4906-4a26-9e2f-5ea476ca9766 req-9734332e-6edf-4971-9cf1-8daa1d97e1d4 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319421 Jun 17 11:04:30.093309 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee6bf31-0ef7-4adc-892e-91e37f73fd8e req-22dc2b43-ae02-4012-9b18-c39a7b61c07f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:30.094768 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5ee6bf31-0ef7-4adc-892e-91e37f73fd8e req-22dc2b43-ae02-4012-9b18-c39a7b61c07f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0612533 Jun 17 11:04:30.132912 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5ee6bf31-0ef7-4adc-892e-91e37f73fd8e req-80b1d305-a2e4-427c-8410-7de7213ebd23 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317230 Jun 17 11:04:30.423063 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd12cf8f-2be1-4b84-91e3-8d6940e4bfd7 req-355636a5-34fa-4e94-b400-a6b7aabe984c tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:30.424539 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bd12cf8f-2be1-4b84-91e3-8d6940e4bfd7 req-355636a5-34fa-4e94-b400-a6b7aabe984c tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0656543 Jun 17 11:04:30.461323 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bd12cf8f-2be1-4b84-91e3-8d6940e4bfd7 req-ece53cb5-86a5-426e-a8a3-42460bc80a69 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311599 Jun 17 11:04:31.309243 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3834c87e-8bbe-4d69-8ebc-cda6a78b0413 req-7d961061-8094-48e7-b395-92bf2cbd75b0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:31.310593 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3834c87e-8bbe-4d69-8ebc-cda6a78b0413 req-7d961061-8094-48e7-b395-92bf2cbd75b0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0687230 Jun 17 11:04:31.350758 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3834c87e-8bbe-4d69-8ebc-cda6a78b0413 req-3f106948-0c33-48c9-a1c5-bfbe37d477f3 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340858 Jun 17 11:04:31.448771 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687107e8-e336-4146-bbe5-e9e9f681bbb1 req-ed6c59d1-cf7b-4334-9cdb-daa145774645 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:31.450217 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-687107e8-e336-4146-bbe5-e9e9f681bbb1 req-ed6c59d1-cf7b-4334-9cdb-daa145774645 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 1098 time: 0.1059847 Jun 17 11:04:31.562337 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687107e8-e336-4146-bbe5-e9e9f681bbb1 req-d3d68a92-8b33-4100-ac38-c7ff5c394471 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:31.563766 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-687107e8-e336-4146-bbe5-e9e9f681bbb1 req-d3d68a92-8b33-4100-ac38-c7ff5c394471 service neutron] 10.222.0.25 "GET /v2.0/networks?id=0fe823e2-06dd-4212-84a6-8e0beda57580 HTTP/1.1" status: 200 len: 920 time: 0.0918715 Jun 17 11:04:31.616533 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-687107e8-e336-4146-bbe5-e9e9f681bbb1 req-a761fcca-82ad-415a-8152-759048cc9624 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2ec3e896-70d1-4c47-933b-7234e4f744ed HTTP/1.1" status: 200 len: 217 time: 0.0453839 Jun 17 11:04:31.686450 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687107e8-e336-4146-bbe5-e9e9f681bbb1 req-b44bca14-6a5a-4f54-acb5-d37ad919966e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:31.687914 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-687107e8-e336-4146-bbe5-e9e9f681bbb1 req-b44bca14-6a5a-4f54-acb5-d37ad919966e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=ab7c7a9f-b422-4b40-b94a-6939be91bbb8 HTTP/1.1" status: 200 len: 859 time: 0.0517445 Jun 17 11:04:31.713477 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a62839a-0d80-4ba9-a03f-729c99a23b57 req-2644c54f-76c6-491a-8a25-b24e56c97ca4 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:31.714914 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2a62839a-0d80-4ba9-a03f-729c99a23b57 req-2644c54f-76c6-491a-8a25-b24e56c97ca4 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.1382339 Jun 17 11:04:31.734261 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-687107e8-e336-4146-bbe5-e9e9f681bbb1 req-14c94b59-39f2-4ca6-bf49-ba053084b120 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=0fe823e2-06dd-4212-84a6-8e0beda57580&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0384104 Jun 17 11:04:31.788355 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2a62839a-0d80-4ba9-a03f-729c99a23b57 req-c242c737-6e22-4dc4-8dc8-f01831e2e374 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568454 Jun 17 11:04:31.850337 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-687107e8-e336-4146-bbe5-e9e9f681bbb1 req-b5b42f9b-aa5e-4fa6-aeb4-f3350b029e0e service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1001821 Jun 17 11:04:31.949974 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-687107e8-e336-4146-bbe5-e9e9f681bbb1 req-464cf4ad-84d4-4123-997a-e9b09aa66559 service neutron] 10.222.0.25 "GET /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874844 Jun 17 11:04:32.263463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3acba155-0bee-4ae4-8368-941e09a61c31 req-40e76a7e-341b-4301-9180-7661f91e49e3 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:32.264783 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3acba155-0bee-4ae4-8368-941e09a61c31 req-40e76a7e-341b-4301-9180-7661f91e49e3 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.25 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 946 time: 0.0624781 Jun 17 11:04:32.363983 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-3acba155-0bee-4ae4-8368-941e09a61c31 req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Deleting port 316b36b2-c75c-42ff-9b5d-368f0037bc5d {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:04:32.364316 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-3acba155-0bee-4ae4-8368-941e09a61c31 req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:32.463268 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-3acba155-0bee-4ae4-8368-941e09a61c31 req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] For port 316b36b2-c75c-42ff-9b5d-368f0037bc5d, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=316b36b2-c75c-42ff-9b5d-368f0037bc5d,segment=NetworkSegment(b30833e2-269b-473f-8667-473b40248da0),segment_id=b30833e2-269b-473f-8667-473b40248da0)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:04:32.463968 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-3acba155-0bee-4ae4-8368-941e09a61c31 req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:32.524752 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4149312-7231-40af-b246-8d547b68ddd4 req-80fbf5a4-8936-4889-bb50-31c5af306b52 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:32.526151 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f4149312-7231-40af-b246-8d547b68ddd4 req-80fbf5a4-8936-4889-bb50-31c5af306b52 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0630708 Jun 17 11:04:32.536003 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-3acba155-0bee-4ae4-8368-941e09a61c31 req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Calling delete_port for 316b36b2-c75c-42ff-9b5d-368f0037bc5d owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:04:32.564812 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f4149312-7231-40af-b246-8d547b68ddd4 req-26e137ac-b49a-4d28-bb92-0f7b5a61c79c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326037 Jun 17 11:04:32.748441 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-3acba155-0bee-4ae4-8368-941e09a61c31 req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:32.753557 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:32.774024 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['316b36b2-c75c-42ff-9b5d-368f0037bc5d'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:04:32.786026 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Pushing event deleted for resources: {'Port': ['ID=316b36b2-c75c-42ff-9b5d-368f0037bc5d,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:32.809014 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:32.830442 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-3acba155-0bee-4ae4-8368-941e09a61c31 req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] No DVR routers for this DVR port 316b36b2-c75c-42ff-9b5d-368f0037bc5d on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:04:32.832922 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-3acba155-0bee-4ae4-8368-941e09a61c31 req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:32.834945 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3acba155-0bee-4ae4-8368-941e09a61c31 req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.25 "DELETE /v2.0/ports/316b36b2-c75c-42ff-9b5d-368f0037bc5d HTTP/1.1" status: 204 len: 173 time: 0.5629842 Jun 17 11:04:32.835451 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ad131e18-76ae-4d60-8e93-58748c554d77', 'name': 'network-vif-deleted', 'tag': '316b36b2-c75c-42ff-9b5d-368f0037bc5d'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:04:32.837747 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7825a23a-0b8c-4744-8b74-5f3e93c809b8" -d '{"events": [{"server_uuid": "ad131e18-76ae-4d60-8e93-58748c554d77", "name": "network-vif-deleted", "tag": "316b36b2-c75c-42ff-9b5d-368f0037bc5d"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:04:32.946003 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-37cccbd6-b91b-4920-bea7-768f712f4227 req-08bf37fb-56bf-4097-a109-7b2b6364b9dd tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 210 time: 0.0326989 Jun 17 11:04:33.059968 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:04:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19d1744d-812f-4b00-8594-730bd66d5684 x-openstack-request-id: req-19d1744d-812f-4b00-8594-730bd66d5684 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:04:33.060361 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ad131e18-76ae-4d60-8e93-58748c554d77", "name": "network-vif-deleted", "tag": "316b36b2-c75c-42ff-9b5d-368f0037bc5d", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:04:33.060716 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-19d1744d-812f-4b00-8594-730bd66d5684 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:04:33.061212 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ad131e18-76ae-4d60-8e93-58748c554d77', 'name': 'network-vif-deleted', 'tag': '316b36b2-c75c-42ff-9b5d-368f0037bc5d', 'status': 'completed', 'code': 200} Jun 17 11:04:34.121501 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9942ff92-8d4a-4ba8-8446-2191b0d57a95 req-8edd2413-48b8-4e27-9180-33d48763418e tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=ad131e18-76ae-4d60-8e93-58748c554d77 HTTP/1.1" status: 200 len: 210 time: 0.0296774 Jun 17 11:04:37.517558 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 316b36b2-c75c-42ff-9b5d-368f0037bc5d no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:04:37.543998 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 316b36b2-c75c-42ff-9b5d-368f0037bc5d {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:04:37.544351 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 316b36b2-c75c-42ff-9b5d-368f0037bc5d not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:04:37.673268 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:41.662971 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363d8bbb-090d-4bce-8073-b4a13cea4297 req-56a01ec2-2254-452f-98ff-f93cacf70e84 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:41.664477 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-363d8bbb-090d-4bce-8073-b4a13cea4297 req-56a01ec2-2254-452f-98ff-f93cacf70e84 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0644565 Jun 17 11:04:41.701640 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-363d8bbb-090d-4bce-8073-b4a13cea4297 req-08622738-2bd6-4505-842c-623aff669ebc tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313191 Jun 17 11:04:42.881371 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ff1f15a-dca7-4642-ad2f-5e4fb96e0ad9 req-d5b345ef-ee69-4cce-9805-a453f018fb0f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:42.883000 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6ff1f15a-dca7-4642-ad2f-5e4fb96e0ad9 req-d5b345ef-ee69-4cce-9805-a453f018fb0f tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0653448 Jun 17 11:04:42.922365 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6ff1f15a-dca7-4642-ad2f-5e4fb96e0ad9 req-c4e01ade-9c18-4476-a429-e8569c56427d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335441 Jun 17 11:04:42.934187 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-313b8303-3902-4b6f-a55d-76ed5035771c req-d198bc04-8b5e-4320-9c94-d23917538cfb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:42.936337 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-313b8303-3902-4b6f-a55d-76ed5035771c req-d198bc04-8b5e-4320-9c94-d23917538cfb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 946 time: 0.0719457 Jun 17 11:04:42.974248 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-313b8303-3902-4b6f-a55d-76ed5035771c req-b37de539-b5fa-4615-b1f6-76102d51bfb2 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316474 Jun 17 11:04:42.999103 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 38572) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:43.131646 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:04:43.150719 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1de74d5e-a26d-4396-9a06-9b397ec6f652 tempest-TestMinimumBasicScenario-1104310343 tempest-TestMinimumBasicScenario-1104310343-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:43.152255 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-1de74d5e-a26d-4396-9a06-9b397ec6f652 tempest-TestMinimumBasicScenario-1104310343 tempest-TestMinimumBasicScenario-1104310343-project-admin] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 1094 time: 0.1521692 Jun 17 11:04:43.155168 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 38576) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:43.159569 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Request body: {'floatingip': {'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'port_id': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'fixed_ip_address': '172.20.0.14'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:04:43.302952 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for floatingip, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:43.401314 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:43.501700 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Allocated IP 172.27.3.15 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/77ff7dd1-d2da-4628-97dc-0ba8cf667284) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:04:43.607097 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:43.697389 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:43.699482 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:43.735289 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:04:43.738111 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:04:43.745194 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:04:43.765953 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'Port': ['ID=77ff7dd1-d2da-4628-97dc-0ba8cf667284,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:43.769807 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:44.091516 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for floatingip, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:44.100065 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1009a19-f253-416f-ac23-28f587c53d18 req-054f7c05-454c-48b8-9193-e13094dea078 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:44.101598 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a1009a19-f253-416f-ac23-28f587c53d18 req-054f7c05-454c-48b8-9193-e13094dea078 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0660179 Jun 17 11:04:44.138214 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a1009a19-f253-416f-ac23-28f587c53d18 req-f9cfc28d-51f8-464c-bee5-78489fd0411a tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310416 Jun 17 11:04:44.244343 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:44.391217 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:44.479613 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:44.481677 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-eb077866-1f98-4834-b3ed-30255154aa3f tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:44.549745 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'Port': ['ID=77ff7dd1-d2da-4628-97dc-0ba8cf667284,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:44.554609 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:44.562554 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:44.660376 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.l3_db [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Floating IP 6dda487f-5f27-4ebc-af57-7e83920b52d2 associated. External IP: 172.27.3.15, port: 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72. Jun 17 11:04:44.860190 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:04:45.193864 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:04:45.203946 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb5a742f-4513-4c6e-be2b-d0c04a794eed None None] Sync routers for ids ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:04:45.212512 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb5a742f-4513-4c6e-be2b-d0c04a794eed None None] Routers {'7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:04:45.213035 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-cb5a742f-4513-4c6e-be2b-d0c04a794eed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:04:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:04:45.293708 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:45.315792 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-cb5a742f-4513-4c6e-be2b-d0c04a794eed None None] Set router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:04:45.344324 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce76b315-251e-4fbf-96c1-bff592204ab9 req-ad7139cf-8930-4556-9a3b-1d930d022503 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:45.345951 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ce76b315-251e-4fbf-96c1-bff592204ab9 req-ad7139cf-8930-4556-9a3b-1d930d022503 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0934818 Jun 17 11:04:45.359478 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2032893 Jun 17 11:04:45.362337 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38594) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:45.365366 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:04:45.367174 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-364ea1eb-953f-4ae2-ae4f-b6f49d4e7a0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1466596722', 'description': 'tempest-secgroup-smoke-1466596722 description', 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:04:45.368601 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9c7a0c1-812f-49af-be70-172ad3dfca15" -d '{"events": [{"name": "network-changed", "server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:04:45.391728 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ce76b315-251e-4fbf-96c1-bff592204ab9 req-8ae2bf49-4221-4fe3-801b-5fb2c9c760d5 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401893 Jun 17 11:04:45.412772 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:04:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d2854c7-c3a1-4f27-a822-5701e2510cb8 x-openstack-request-id: req-1d2854c7-c3a1-4f27-a822-5701e2510cb8 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:04:45.413211 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:04:45.413500 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-1d2854c7-c3a1-4f27-a822-5701e2510cb8 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:04:45.414058 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'status': 'completed', 'code': 200} Jun 17 11:04:45.496951 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-364ea1eb-953f-4ae2-ae4f-b6f49d4e7a0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:45.542479 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-cb5a742f-4513-4c6e-be2b-d0c04a794eed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 4, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '6dda487f-5f27-4ebc-af57-7e83920b52d2', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'floating_ip_address': '172.27.3.15', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'port_id': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 503, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'mac_address': 'fa:16:3e:41:26:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:04:43Z', 'updated_at': '2021-06-17T11:04:43Z', 'revision_number': 0, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fc90a0fd-7ca9-4a92-a265-28ce1dd9160f', 'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'mac_address': 'fa:16:3e:88:9a:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:27Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 5, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'subnets': [{'id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:04:45.571830 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb5a742f-4513-4c6e-be2b-d0c04a794eed None None] Checking router: 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:04:45.577560 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-364ea1eb-953f-4ae2-ae4f-b6f49d4e7a0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:45.580349 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb5a742f-4513-4c6e-be2b-d0c04a794eed None None] Routers {'7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:04:45.581010 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-cb5a742f-4513-4c6e-be2b-d0c04a794eed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:04:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:04:45.640161 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-364ea1eb-953f-4ae2-ae4f-b6f49d4e7a0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:45.643139 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-80abc420-c360-4796-9b77-7901c21db673 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:45.669489 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-364ea1eb-953f-4ae2-ae4f-b6f49d4e7a0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e981b014-56d8-44c5-8806-e0c8684083c6,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:45.672457 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-364ea1eb-953f-4ae2-ae4f-b6f49d4e7a0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:45.690421 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-cb5a742f-4513-4c6e-be2b-d0c04a794eed None None] Set router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:04:45.730914 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-364ea1eb-953f-4ae2-ae4f-b6f49d4e7a0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:45.732159 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-364ea1eb-953f-4ae2-ae4f-b6f49d4e7a0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.3688018 Jun 17 11:04:45.735234 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 38600) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:45.742809 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-844a048b-8e4d-4288-b426-6a05da544d33 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Request body: {'security_group_rule': {'security_group_id': 'e981b014-56d8-44c5-8806-e0c8684083c6', 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:04:45.845717 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-844a048b-8e4d-4288-b426-6a05da544d33 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:45.891805 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-844a048b-8e4d-4288-b426-6a05da544d33 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:45.929324 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-cb5a742f-4513-4c6e-be2b-d0c04a794eed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 4, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '6dda487f-5f27-4ebc-af57-7e83920b52d2', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'floating_ip_address': '172.27.3.15', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'port_id': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 503, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'mac_address': 'fa:16:3e:41:26:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:04:43Z', 'updated_at': '2021-06-17T11:04:43Z', 'revision_number': 0, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fc90a0fd-7ca9-4a92-a265-28ce1dd9160f', 'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'mac_address': 'fa:16:3e:88:9a:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:27Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 5, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'subnets': [{'id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:04:45.953693 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb5a742f-4513-4c6e-be2b-d0c04a794eed None None] The sync data for ids ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'] in dv-cinder-773870-6-iscsi is: [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 4, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '6dda487f-5f27-4ebc-af57-7e83920b52d2', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'floating_ip_address': '172.27.3.15', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'port_id': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 503, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'mac_address': 'fa:16:3e:41:26:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:04:43Z', 'updated_at': '2021-06-17T11:04:43Z', 'revision_number': 0, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fc90a0fd-7ca9-4a92-a265-28ce1dd9160f', 'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'mac_address': 'fa:16:3e:88:9a:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:27Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 5, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'subnets': [{'id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:04:45.959797 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-844a048b-8e4d-4288-b426-6a05da544d33 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:45.961951 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:45.979022 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-844a048b-8e4d-4288-b426-6a05da544d33 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=55cfb09c-497e-4a3d-b395-bd0037764e38,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:45.982056 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-844a048b-8e4d-4288-b426-6a05da544d33 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:46.035378 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-844a048b-8e4d-4288-b426-6a05da544d33 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:46.037364 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-844a048b-8e4d-4288-b426-6a05da544d33 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3011034 Jun 17 11:04:46.040245 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38602) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:46.044997 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-a2b4be7e-8e1f-43f1-82d2-bfd3037e885e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Request body: {'security_group_rule': {'security_group_id': 'e981b014-56d8-44c5-8806-e0c8684083c6', 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:04:46.141434 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38cb1194-cd3f-4b8e-8f3c-25c9c7ff129b None None] New status for floating IP 6dda487f-5f27-4ebc-af57-7e83920b52d2: ACTIVE {{(pid=110216) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:04:46.148389 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a2b4be7e-8e1f-43f1-82d2-bfd3037e885e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:46.221869 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a2b4be7e-8e1f-43f1-82d2-bfd3037e885e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:46.297350 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a2b4be7e-8e1f-43f1-82d2-bfd3037e885e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:46.299462 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:46.318348 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2b4be7e-8e1f-43f1-82d2-bfd3037e885e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2676fe4d-4a5e-4c3f-9262-6c79f8454eba,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:46.321215 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a2b4be7e-8e1f-43f1-82d2-bfd3037e885e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:46.378441 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a2b4be7e-8e1f-43f1-82d2-bfd3037e885e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:46.379714 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-a2b4be7e-8e1f-43f1-82d2-bfd3037e885e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3385556 Jun 17 11:04:46.383104 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 38608) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:46.393162 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-5b442ae7-5946-486f-a86e-072b121119af tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Request body: {'security_group_rule': {'security_group_id': 'e981b014-56d8-44c5-8806-e0c8684083c6', 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:04:46.490470 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5b442ae7-5946-486f-a86e-072b121119af tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:46.599881 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5b442ae7-5946-486f-a86e-072b121119af tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:46.616531 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db7e826c-7784-494a-8108-c8a831d6400a req-a81859f6-e9bc-48ce-a3e6-316a6769fd56 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:46.617918 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-db7e826c-7784-494a-8108-c8a831d6400a req-a81859f6-e9bc-48ce-a3e6-316a6769fd56 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.1054604 Jun 17 11:04:46.655598 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-db7e826c-7784-494a-8108-c8a831d6400a req-b9b14b49-06bd-4ba7-8265-1f20b52e35f3 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318005 Jun 17 11:04:46.679882 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5b442ae7-5946-486f-a86e-072b121119af tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:46.681959 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:46.700985 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b442ae7-5946-486f-a86e-072b121119af tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=39b20f2e-4587-4f35-aa2f-ca33c03c082a,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:46.707343 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5b442ae7-5946-486f-a86e-072b121119af tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:46.777017 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5b442ae7-5946-486f-a86e-072b121119af tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:46.778200 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-5b442ae7-5946-486f-a86e-072b121119af tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3940563 Jun 17 11:04:46.781058 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38614) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:46.785866 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-5e4fbdb4-27cf-4d97-ba76-0dc1b35809f7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Request body: {'security_group_rule': {'security_group_id': 'e981b014-56d8-44c5-8806-e0c8684083c6', 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:04:46.879548 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5e4fbdb4-27cf-4d97-ba76-0dc1b35809f7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:46.958011 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5e4fbdb4-27cf-4d97-ba76-0dc1b35809f7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:46.977190 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9c7a0c1-812f-49af-be70-172ad3dfca15 req-3e7ca41a-1f34-45a4-b32e-e236c097ba7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:46.978813 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9c7a0c1-812f-49af-be70-172ad3dfca15 req-3e7ca41a-1f34-45a4-b32e-e236c097ba7d service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ed69cf6aa40941c48c25effb0c1af8fc&device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 1099 time: 0.0622082 Jun 17 11:04:47.045370 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5e4fbdb4-27cf-4d97-ba76-0dc1b35809f7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:47.047531 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:47.063916 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e4fbdb4-27cf-4d97-ba76-0dc1b35809f7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f5ebd796-bce6-4461-9b9b-03e000e8bd43,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:47.066704 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5e4fbdb4-27cf-4d97-ba76-0dc1b35809f7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:47.078304 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9c7a0c1-812f-49af-be70-172ad3dfca15 req-c4e423a5-69ad-4bca-a062-78297fc863ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:47.080012 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9c7a0c1-812f-49af-be70-172ad3dfca15 req-c4e423a5-69ad-4bca-a062-78297fc863ea service neutron] 10.222.0.25 "GET /v2.0/networks?id=aeced3ed-7670-4043-a385-87de6f75150b HTTP/1.1" status: 200 len: 916 time: 0.0949371 Jun 17 11:04:47.144236 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9c7a0c1-812f-49af-be70-172ad3dfca15 req-bdc5f226-410a-474b-b0e1-65ae7e9c499d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 HTTP/1.1" status: 200 len: 1001 time: 0.0567501 Jun 17 11:04:47.159406 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5e4fbdb4-27cf-4d97-ba76-0dc1b35809f7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:47.160586 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-5e4fbdb4-27cf-4d97-ba76-0dc1b35809f7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3785195 Jun 17 11:04:47.163857 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38626) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:47.168445 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-bdaba5ca-8779-401d-bb47-826c405291d4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Request body: {'security_group_rule': {'security_group_id': 'e981b014-56d8-44c5-8806-e0c8684083c6', 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:04:47.230296 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9c7a0c1-812f-49af-be70-172ad3dfca15 req-ab152dd4-1cdd-43d1-b7c5-2a25c2346a22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:47.231791 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9c7a0c1-812f-49af-be70-172ad3dfca15 req-ab152dd4-1cdd-43d1-b7c5-2a25c2346a22 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=5d332463-1c62-46e2-a7e3-4b587a2e5f1e HTTP/1.1" status: 200 len: 854 time: 0.0453312 Jun 17 11:04:47.250663 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.securitygroups_db [None req-bdaba5ca-8779-401d-bb47-826c405291d4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Project ed69cf6aa40941c48c25effb0c1af8fc added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jun 17 11:04:47.257053 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bdaba5ca-8779-401d-bb47-826c405291d4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:47.301384 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9c7a0c1-812f-49af-be70-172ad3dfca15 req-1172aa35-d5e3-4f10-9192-124515df5c6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:47.302901 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9c7a0c1-812f-49af-be70-172ad3dfca15 req-1172aa35-d5e3-4f10-9192-124515df5c6e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=aeced3ed-7670-4043-a385-87de6f75150b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0597200 Jun 17 11:04:47.324750 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bdaba5ca-8779-401d-bb47-826c405291d4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:47.397127 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9c7a0c1-812f-49af-be70-172ad3dfca15 req-c01510ec-778a-46c8-88b2-b36b4e1e9cc9 service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853586 Jun 17 11:04:47.456637 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bdaba5ca-8779-401d-bb47-826c405291d4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:47.461127 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5e4fbdb4-27cf-4d97-ba76-0dc1b35809f7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:47.483466 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdaba5ca-8779-401d-bb47-826c405291d4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=782c5db8-67ca-4105-b75e-d151f982189f,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:47.486549 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-bdaba5ca-8779-401d-bb47-826c405291d4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:47.499939 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9c7a0c1-812f-49af-be70-172ad3dfca15 req-4a9ddc02-8b16-4daf-b49a-0483388a5c87 service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0953159 Jun 17 11:04:47.593829 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bdaba5ca-8779-401d-bb47-826c405291d4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:47.595109 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-bdaba5ca-8779-401d-bb47-826c405291d4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4302027 Jun 17 11:04:47.598024 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38634) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:04:47.602742 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-09ad117e-b9e8-4922-8eef-cd2c82e251e1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Request body: {'security_group_rule': {'security_group_id': 'e981b014-56d8-44c5-8806-e0c8684083c6', 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:04:47.662894 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.securitygroups_db [None req-09ad117e-b9e8-4922-8eef-cd2c82e251e1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Project ed69cf6aa40941c48c25effb0c1af8fc added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jun 17 11:04:47.668178 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-09ad117e-b9e8-4922-8eef-cd2c82e251e1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:47.751580 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-09ad117e-b9e8-4922-8eef-cd2c82e251e1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:47.814445 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-09ad117e-b9e8-4922-8eef-cd2c82e251e1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:47.821090 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-bdaba5ca-8779-401d-bb47-826c405291d4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:47.843137 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09ad117e-b9e8-4922-8eef-cd2c82e251e1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=08557716-9a0a-41f7-85c4-c20cb6689d62,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:47.849462 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-09ad117e-b9e8-4922-8eef-cd2c82e251e1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:47.870136 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf27610-9e62-4d38-9cc5-c91624c4b4da req-b661ec42-3fd5-45bc-9c1c-8f7d98b7edcd tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:47.871734 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-dbf27610-9e62-4d38-9cc5-c91624c4b4da req-b661ec42-3fd5-45bc-9c1c-8f7d98b7edcd tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.0956240 Jun 17 11:04:47.914518 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-dbf27610-9e62-4d38-9cc5-c91624c4b4da req-9dfa9a18-4989-4385-b1d9-05bee1142397 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365236 Jun 17 11:04:47.933433 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-09ad117e-b9e8-4922-8eef-cd2c82e251e1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:47.935774 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-09ad117e-b9e8-4922-8eef-cd2c82e251e1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3366704 Jun 17 11:04:48.003709 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-3f122688-dba5-4e2a-aa8c-58159fb8d1de tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:48.003709 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-3f122688-dba5-4e2a-aa8c-58159fb8d1de tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/networks?id=ac073896-1dc1-4a1c-bbb5-f73d05a0f328 HTTP/1.1" status: 200 len: 814 time: 0.1081147 Jun 17 11:04:48.017828 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fa94be6f-7c13-418a-9da7-c2499aae4294 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/quotas/639911d94d744c97a47444f2f5785c40 HTTP/1.1" status: 200 len: 375 time: 0.0093961 Jun 17 11:04:48.052882 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-dd74ae13-9645-4bb7-a1f2-cd9d0fd5f517 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=639911d94d744c97a47444f2f5785c40&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0294049 Jun 17 11:04:48.067233 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f6910e09-266e-48c0-a66f-92951b92a0f6 req-e0051123-f6d3-4352-b586-390f2e2228e2 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1466596722&fields=id&tenant_id=ed69cf6aa40941c48c25effb0c1af8fc HTTP/1.1" status: 200 len: 267 time: 0.0436404 Jun 17 11:04:48.138762 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6910e09-266e-48c0-a66f-92951b92a0f6 req-ed753d16-47d5-4ea8-9790-275c1ebd876f tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:48.140451 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f6910e09-266e-48c0-a66f-92951b92a0f6 req-ed753d16-47d5-4ea8-9790-275c1ebd876f tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 946 time: 0.0666046 Jun 17 11:04:48.153021 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [req-f6910e09-266e-48c0-a66f-92951b92a0f6 req-1920aa0c-741b-4ef1-8a07-24c9828344cb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Request body: {'port': {'security_groups': ['d13c205a-f6de-4b53-abc9-1484c3d728be', 'e981b014-56d8-44c5-8806-e0c8684083c6']}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:04:48.228684 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-201f3f4f-a2f3-43b7-b7fe-8c120afc55b5 service neutron] 10.222.0.41 "GET /v2.0/networks/ac073896-1dc1-4a1c-bbb5-f73d05a0f328?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1676373 Jun 17 11:04:48.269377 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa3c3d38-7998-45b5-8a74-89f73c3c01bf req-d4c1bbf5-e3fe-45a5-97a6-ed62f0bfbfa2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:48.271151 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-aa3c3d38-7998-45b5-8a74-89f73c3c01bf req-d4c1bbf5-e3fe-45a5-97a6-ed62f0bfbfa2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.25 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 945 time: 0.1348493 Jun 17 11:04:48.404265 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-24827108-2eff-47a6-8fe3-2130cd6227e0 service neutron] 10.222.0.41 "GET /v2.0/networks/ac073896-1dc1-4a1c-bbb5-f73d05a0f328?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1653631 Jun 17 11:04:48.431734 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-aa3c3d38-7998-45b5-8a74-89f73c3c01bf req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Deleting port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:04:48.432073 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-aa3c3d38-7998-45b5-8a74-89f73c3c01bf req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:48.461201 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-f6910e09-266e-48c0-a66f-92951b92a0f6 req-1920aa0c-741b-4ef1-8a07-24c9828344cb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:48.537658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-aa3c3d38-7998-45b5-8a74-89f73c3c01bf req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] For port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:04:48.538157 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-aa3c3d38-7998-45b5-8a74-89f73c3c01bf req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:48.611503 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-aa3c3d38-7998-45b5-8a74-89f73c3c01bf req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Calling delete_port for f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:04:48.707385 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [req-f6910e09-266e-48c0-a66f-92951b92a0f6 req-1920aa0c-741b-4ef1-8a07-24c9828344cb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] For port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:04:48.729453 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-345c2455-fd38-4e12-b4c5-6661e98ca37e req-cc649ff4-67b9-4f6b-8811-89a0f191feca tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 210 time: 0.0295594 Jun 17 11:04:48.741740 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-f6910e09-266e-48c0-a66f-92951b92a0f6 req-1920aa0c-741b-4ef1-8a07-24c9828344cb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:48.811431 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-f6910e09-266e-48c0-a66f-92951b92a0f6 req-1920aa0c-741b-4ef1-8a07-24c9828344cb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:48.816615 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:48.824914 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:04:48.862082 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6910e09-266e-48c0-a66f-92951b92a0f6 req-1920aa0c-741b-4ef1-8a07-24c9828344cb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:48.862730 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-f6910e09-266e-48c0-a66f-92951b92a0f6 req-1920aa0c-741b-4ef1-8a07-24c9828344cb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for port, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:48.868455 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f6910e09-266e-48c0-a66f-92951b92a0f6 req-1920aa0c-741b-4ef1-8a07-24c9828344cb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "PUT /v2.0/ports/5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 HTTP/1.1" status: 200 len: 982 time: 0.7205830 Jun 17 11:04:48.869184 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'}] {{(pid=110214) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:04:48.872431 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cc2cf72888dbbd14a3b8c118b05d43e907687f619eecab2abc2da29781eba8b9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46f545ee-5614-4c4e-8d9e-edbe55900219" -d '{"events": [{"name": "network-changed", "server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72"}]}' {{(pid=110214) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:04:48.916219 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1920aa0c-741b-4ef1-8a07-24c9828344cb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'Port': ['ID=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,revision_number=6']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:48.925454 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-1920aa0c-741b-4ef1-8a07-24c9828344cb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:48.931972 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-aa3c3d38-7998-45b5-8a74-89f73c3c01bf req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:48.942841 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ef159559-bd76-4dcd-9e07-a3912ddc1dd1 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:48.989264 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Pushing event deleted for resources: {'Port': ['ID=f47e3e1a-e4f2-4b14-b64a-a67d84ad7677,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:49.019462 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:04:49.047877 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:49.051311 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:04:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb1c4389-c85f-45ff-b9f9-21478ebe8323 x-openstack-request-id: req-bb1c4389-c85f-45ff-b9f9-21478ebe8323 {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:04:49.057539 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72", "status": "completed", "code": 200}]} {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:04:49.058224 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-bb1c4389-c85f-45ff-b9f9-21478ebe8323 {{(pid=110214) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:04:49.058778 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'status': 'completed', 'code': 200} Jun 17 11:04:49.128359 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-aa3c3d38-7998-45b5-8a74-89f73c3c01bf req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] No DVR routers for this DVR port f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:04:49.149405 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-aa3c3d38-7998-45b5-8a74-89f73c3c01bf req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:49.152539 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-aa3c3d38-7998-45b5-8a74-89f73c3c01bf req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.25 "DELETE /v2.0/ports/f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 HTTP/1.1" status: 204 len: 173 time: 0.8686810 Jun 17 11:04:49.158086 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4b6a250-cbe9-4e83-88f3-7dfe006deb6b', 'name': 'network-vif-deleted', 'tag': 'f47e3e1a-e4f2-4b14-b64a-a67d84ad7677'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:04:49.171785 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4e482ea-4751-4344-b8a6-4534497af497" -d '{"events": [{"server_uuid": "a4b6a250-cbe9-4e83-88f3-7dfe006deb6b", "name": "network-vif-deleted", "tag": "f47e3e1a-e4f2-4b14-b64a-a67d84ad7677"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:04:49.243573 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa52dd22-5b48-475e-a4e3-7f72f2304a21 req-f186b174-c6b9-4bf5-99dc-d34b7c8d82eb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:49.245282 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fa52dd22-5b48-475e-a4e3-7f72f2304a21 req-f186b174-c6b9-4bf5-99dc-d34b7c8d82eb tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.1992030 Jun 17 11:04:49.247627 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f545ee-5614-4c4e-8d9e-edbe55900219 req-5b9a8e3c-368b-4696-936f-0a46661d96a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:49.249008 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-46f545ee-5614-4c4e-8d9e-edbe55900219 req-5b9a8e3c-368b-4696-936f-0a46661d96a2 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ed69cf6aa40941c48c25effb0c1af8fc&device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 1138 time: 0.1521695 Jun 17 11:04:49.256130 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-615ddeb4-72a8-4b4d-b304-8d8d63fc2733 req-c6bdee76-043c-43ba-b126-73f44345f0b7 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 210 time: 0.0568902 Jun 17 11:04:49.363727 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:04:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad392925-584a-4ed7-b78b-8b14a891296a x-openstack-request-id: req-ad392925-584a-4ed7-b78b-8b14a891296a {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:04:49.364159 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a4b6a250-cbe9-4e83-88f3-7dfe006deb6b", "name": "network-vif-deleted", "tag": "f47e3e1a-e4f2-4b14-b64a-a67d84ad7677", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:04:49.364439 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-ad392925-584a-4ed7-b78b-8b14a891296a {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:04:49.364789 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4b6a250-cbe9-4e83-88f3-7dfe006deb6b', 'name': 'network-vif-deleted', 'tag': 'f47e3e1a-e4f2-4b14-b64a-a67d84ad7677', 'status': 'completed', 'code': 200} Jun 17 11:04:49.392274 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fa52dd22-5b48-475e-a4e3-7f72f2304a21 req-d222de6e-8f49-400a-b17c-15b07c645549 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1264257 Jun 17 11:04:49.404365 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-8e48dc64-ea65-4afa-bf98-f033451c5249 None None] Provisioning complete for port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:04:49.405008 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8e48dc64-ea65-4afa-bf98-f033451c5249 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:49.411780 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f545ee-5614-4c4e-8d9e-edbe55900219 req-84ebe41f-a423-4f30-9763-86e972be87a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:49.413533 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-46f545ee-5614-4c4e-8d9e-edbe55900219 req-84ebe41f-a423-4f30-9763-86e972be87a5 service neutron] 10.222.0.25 "GET /v2.0/networks?id=aeced3ed-7670-4043-a385-87de6f75150b HTTP/1.1" status: 200 len: 916 time: 0.1461120 Jun 17 11:04:49.525669 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-46f545ee-5614-4c4e-8d9e-edbe55900219 req-d9f7150d-706b-4c3a-91b1-bb6a70ae0dce service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 HTTP/1.1" status: 200 len: 1001 time: 0.1008635 Jun 17 11:04:49.580253 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f545ee-5614-4c4e-8d9e-edbe55900219 req-4defd211-58c8-4511-88a0-5f795d6aa347 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:49.580602 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-46f545ee-5614-4c4e-8d9e-edbe55900219 req-4defd211-58c8-4511-88a0-5f795d6aa347 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=5d332463-1c62-46e2-a7e3-4b587a2e5f1e HTTP/1.1" status: 200 len: 854 time: 0.0482533 Jun 17 11:04:49.649915 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f545ee-5614-4c4e-8d9e-edbe55900219 req-4f9986fc-11d4-4077-b89a-53b2d2d2dfb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:49.651887 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-46f545ee-5614-4c4e-8d9e-edbe55900219 req-4f9986fc-11d4-4077-b89a-53b2d2d2dfb9 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=aeced3ed-7670-4043-a385-87de6f75150b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0643277 Jun 17 11:04:49.763966 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-46f545ee-5614-4c4e-8d9e-edbe55900219 req-b6dc97cc-1ea4-486e-bc39-96a0c8b57f04 service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0999720 Jun 17 11:04:49.821285 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-309c85d9-394a-4046-996f-36b10038fbab req-6c98ec80-3de4-4892-bcfe-eae95f5a0b25 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 210 time: 0.0297709 Jun 17 11:04:49.855598 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-46f545ee-5614-4c4e-8d9e-edbe55900219 req-bf9247d3-aec0-42c3-97a1-c479efe4679e service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836966 Jun 17 11:04:49.858405 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['2ec3e896-70d1-4c47-933b-7234e4f744ed'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:04:50.437991 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a125dbe0-855c-4895-b511-cabed6afad5f req-7b552dc2-dbe6-47a5-a650-5cd7c49f47df tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a4b6a250-cbe9-4e83-88f3-7dfe006deb6b HTTP/1.1" status: 200 len: 210 time: 0.0285962 Jun 17 11:04:50.672650 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3011a838-3833-453e-945e-ff67e67c0cf8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:50.837389 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:04:50.860977 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:04:50.861539 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device f47e3e1a-e4f2-4b14-b64a-a67d84ad7677 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:04:50.959910 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-68b87dba-e578-4b09-93cc-22784ac23ee7 req-0cb88eaa-e985-46cc-af27-933fabf74b69 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 210 time: 0.0286472 Jun 17 11:04:51.595330 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-126cccdd-9075-4a10-bcfc-e322a5d33946 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:51.596747 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-126cccdd-9075-4a10-bcfc-e322a5d33946 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.25 "GET /v2.0/networks?id=ac073896-1dc1-4a1c-bbb5-f73d05a0f328 HTTP/1.1" status: 200 len: 814 time: 0.1146562 Jun 17 11:04:51.616527 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Request body: {'port': {'device_id': '4ebf62d4-7f7c-4434-a11c-4d42d419c7d7', 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328', 'admin_state_up': True, 'tenant_id': '639911d94d744c97a47444f2f5785c40'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:04:51.811413 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Made reservation on behalf of 639911d94d744c97a47444f2f5785c40 for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:04:51.820391 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:51.955992 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Allocated IP 172.20.0.10 (ac073896-1dc1-4a1c-bbb5-f73d05a0f328/4f767ce8-3cfb-498b-9928-86e92efe06d9/6f120683-9585-46d0-bfd8-a6c28bf5562f) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:04:52.112711 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6bf235f5-ee59-4c1a-898f-aecf4dfdb0e1 req-61dd777e-44c1-4d66-9703-c5bb3d91e85f tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 210 time: 0.0344949 Jun 17 11:04:52.155629 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:52.193482 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2bd6060-3713-4e25-be1b-aec92d103910 req-b4c5527f-f582-48e1-864f-b0ad8716ae71 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:52.195855 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b2bd6060-3713-4e25-be1b-aec92d103910 req-b4c5527f-f582-48e1-864f-b0ad8716ae71 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0859227 Jun 17 11:04:52.241163 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b2bd6060-3713-4e25-be1b-aec92d103910 req-7950686f-8636-4e3b-a468-cc47857e1aa9 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389073 Jun 17 11:04:52.263128 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:52.267478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ae20ef1e-5539-4cb9-b1b4-72a10e3a4511 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:52.312009 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:04:52.315444 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:04:52.323661 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:04:52.344770 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Pushing event updated for resources: {'Port': ['ID=6f120683-9585-46d0-bfd8-a6c28bf5562f,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:52.349014 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:52.372499 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:52.373127 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:52.492134 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8799691 Jun 17 11:04:52.506875 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Request body: {'port': {'device_id': '4ebf62d4-7f7c-4434-a11c-4d42d419c7d7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:04:52.592549 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:52.871274 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6f120683-9585-46d0-bfd8-a6c28bf5562f {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:04:52.878506 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:52.892145 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Transition to ACTIVE for port object 6f120683-9585-46d0-bfd8-a6c28bf5562f will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:04:52.960047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:52.962301 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:53.035300 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Pushing event updated for resources: {'Port': ['ID=6f120683-9585-46d0-bfd8-a6c28bf5562f,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:53.039606 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:53.108305 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Attempting to bind port 6f120683-9585-46d0-bfd8-a6c28bf5562f on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:04:53.108638 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Attempting to bind port 6f120683-9585-46d0-bfd8-a6c28bf5562f by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': 'b30833e2-269b-473f-8667-473b40248da0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:04:53.108964 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Attempting to bind port 6f120683-9585-46d0-bfd8-a6c28bf5562f on network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:04:53.113693 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Port 6f120683-9585-46d0-bfd8-a6c28bf5562f on network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:04:53.114011 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Attempting to bind port 6f120683-9585-46d0-bfd8-a6c28bf5562f on network ac073896-1dc1-4a1c-bbb5-f73d05a0f328 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:04:53.118793 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 4, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:04:53.119149 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Checking segment: {'id': 'b30833e2-269b-473f-8667-473b40248da0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:04:53.119524 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Bound using segment: {'id': 'b30833e2-269b-473f-8667-473b40248da0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:04:53.119943 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Bound port: 6f120683-9585-46d0-bfd8-a6c28bf5562f, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b30833e2-269b-473f-8667-473b40248da0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:04:53.120285 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:53.183802 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] For port 6f120683-9585-46d0-bfd8-a6c28bf5562f, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:04:53.186796 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] For port 6f120683-9585-46d0-bfd8-a6c28bf5562f, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=6f120683-9585-46d0-bfd8-a6c28bf5562f,segment=NetworkSegment(b30833e2-269b-473f-8667-473b40248da0),segment_id=b30833e2-269b-473f-8667-473b40248da0)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:04:53.276435 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:53.282472 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6cf9a01b-ed48-483f-8c89-42f32238edad tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:53.313858 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3036fe24-696b-4104-b740-d3b462198334 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:53.326710 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49103d14-8ee8-4f36-9b7a-2f5792cb9a53 req-6359d7ce-c727-4ccd-890b-322b132dd0ae tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:53.326710 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-49103d14-8ee8-4f36-9b7a-2f5792cb9a53 req-6359d7ce-c727-4ccd-890b-322b132dd0ae tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 944 time: 0.0997725 Jun 17 11:04:53.334480 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:53.335110 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:53.336557 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] 10.222.0.25 "PUT /v2.0/ports/6f120683-9585-46d0-bfd8-a6c28bf5562f HTTP/1.1" status: 200 len: 1094 time: 0.8349998 Jun 17 11:04:53.337090 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ebf62d4-7f7c-4434-a11c-4d42d419c7d7', 'tag': '6f120683-9585-46d0-bfd8-a6c28bf5562f'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:04:53.339784 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d257ecbe-175e-42dc-a137-5d4d007383fc" -d '{"events": [{"name": "network-changed", "server_uuid": "4ebf62d4-7f7c-4434-a11c-4d42d419c7d7", "tag": "6f120683-9585-46d0-bfd8-a6c28bf5562f"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:04:53.378250 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Pushing event updated for resources: {'Port': ['ID=6f120683-9585-46d0-bfd8-a6c28bf5562f,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:53.383332 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:53.396980 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-49103d14-8ee8-4f36-9b7a-2f5792cb9a53 req-2910d3a4-3092-4f4b-8e5f-34482aed852e tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539970 Jun 17 11:04:53.440181 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8856855-df9e-4d3b-8eca-fbecde3ab9f0 req-75c63520-42e9-4b2a-b834-62e1ae4f1d18 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:53.442950 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a8856855-df9e-4d3b-8eca-fbecde3ab9f0 req-75c63520-42e9-4b2a-b834-62e1ae4f1d18 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0792079 Jun 17 11:04:53.467670 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:04:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-430d9534-9e92-4256-aaab-0a691cf08b56 x-openstack-request-id: req-430d9534-9e92-4256-aaab-0a691cf08b56 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:04:53.467996 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ebf62d4-7f7c-4434-a11c-4d42d419c7d7", "tag": "6f120683-9585-46d0-bfd8-a6c28bf5562f", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:04:53.468371 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-430d9534-9e92-4256-aaab-0a691cf08b56 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:04:53.468799 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ebf62d4-7f7c-4434-a11c-4d42d419c7d7', 'tag': '6f120683-9585-46d0-bfd8-a6c28bf5562f', 'status': 'completed', 'code': 200} Jun 17 11:04:53.483975 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a8856855-df9e-4d3b-8eca-fbecde3ab9f0 req-2dc68d77-3284-4abd-aaf9-a375b0941326 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333140 Jun 17 11:04:53.495005 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-5d39ec89-f6ca-4d85-a926-77632cc9d35c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:53.496612 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-5d39ec89-f6ca-4d85-a926-77632cc9d35c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=639911d94d744c97a47444f2f5785c40&device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 1097 time: 0.0574007 Jun 17 11:04:53.546390 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-7882b11f-64fd-442a-a8d3-1103bcaf55c3 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6f120683-9585-46d0-bfd8-a6c28bf5562f HTTP/1.1" status: 200 len: 217 time: 0.0398037 Jun 17 11:04:53.554001 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:53.596458 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-a19f62c3-785a-490a-aa3e-0024148c2c2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:53.598085 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-a19f62c3-785a-490a-aa3e-0024148c2c2b service neutron] 10.222.0.25 "GET /v2.0/subnets?id=4f767ce8-3cfb-498b-9928-86e92efe06d9 HTTP/1.1" status: 200 len: 854 time: 0.0446568 Jun 17 11:04:53.633607 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-cf6a1233-2ebb-4e6b-a44e-0a34a5e800c6 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ac073896-1dc1-4a1c-bbb5-f73d05a0f328&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0268850 Jun 17 11:04:53.973553 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-cfcf3332-550c-4263-a463-8153e49f6dce service neutron] 10.222.0.25 "GET /v2.0/networks/ac073896-1dc1-4a1c-bbb5-f73d05a0f328?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3290169 Jun 17 11:04:54.066693 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-39efd8e9-4ebf-482a-9c19-3aa1062062bf req-92efb621-bd95-41f1-9191-6c19d124dbd7 service neutron] 10.222.0.25 "GET /v2.0/networks/ac073896-1dc1-4a1c-bbb5-f73d05a0f328?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836139 Jun 17 11:04:54.227482 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d257ecbe-175e-42dc-a137-5d4d007383fc req-b6b0f8e5-f9d3-484a-ae34-9d027abb5b3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:54.228875 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d257ecbe-175e-42dc-a137-5d4d007383fc req-b6b0f8e5-f9d3-484a-ae34-9d027abb5b3d service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=639911d94d744c97a47444f2f5785c40&device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 1097 time: 0.0545959 Jun 17 11:04:54.327106 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d257ecbe-175e-42dc-a137-5d4d007383fc req-1c843bad-def2-42fb-98cf-78ef8141b3d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:54.328586 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d257ecbe-175e-42dc-a137-5d4d007383fc req-1c843bad-def2-42fb-98cf-78ef8141b3d5 service neutron] 10.222.0.25 "GET /v2.0/networks?id=ac073896-1dc1-4a1c-bbb5-f73d05a0f328 HTTP/1.1" status: 200 len: 915 time: 0.0909431 Jun 17 11:04:54.375061 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d257ecbe-175e-42dc-a137-5d4d007383fc req-de3ba3b6-799e-4940-8495-d7e36347c041 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6f120683-9585-46d0-bfd8-a6c28bf5562f HTTP/1.1" status: 200 len: 217 time: 0.0356872 Jun 17 11:04:54.431933 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d257ecbe-175e-42dc-a137-5d4d007383fc req-8272032f-0657-44f5-9ef1-1a54026b9240 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:54.433378 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d257ecbe-175e-42dc-a137-5d4d007383fc req-8272032f-0657-44f5-9ef1-1a54026b9240 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=4f767ce8-3cfb-498b-9928-86e92efe06d9 HTTP/1.1" status: 200 len: 854 time: 0.0476768 Jun 17 11:04:54.470304 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d257ecbe-175e-42dc-a137-5d4d007383fc req-a00c0476-292a-45cd-a601-92b2df39b42d service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=ac073896-1dc1-4a1c-bbb5-f73d05a0f328&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0274391 Jun 17 11:04:54.497189 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:54.604598 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d257ecbe-175e-42dc-a137-5d4d007383fc req-a4aa5000-da5c-4eb7-8e66-532f5b465c1f service neutron] 10.222.0.25 "GET /v2.0/networks/ac073896-1dc1-4a1c-bbb5-f73d05a0f328?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273363 Jun 17 11:04:54.656374 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d7fc68-c3cf-44cf-838f-c8c1eddff6cd req-d94f5b5c-19e3-420e-b93d-74371106e026 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:54.657843 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-92d7fc68-c3cf-44cf-838f-c8c1eddff6cd req-d94f5b5c-19e3-420e-b93d-74371106e026 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 944 time: 0.1174648 Jun 17 11:04:54.669527 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b296a6-da12-4507-94fe-75c1fd574fd9 req-19633991-39dc-4dbf-8d4d-4862ff556438 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:54.672978 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-07b296a6-da12-4507-94fe-75c1fd574fd9 req-19633991-39dc-4dbf-8d4d-4862ff556438 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0701487 Jun 17 11:04:54.712011 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-07b296a6-da12-4507-94fe-75c1fd574fd9 req-a125e707-eca1-4e9a-8b0f-fd381a9cce34 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352738 Jun 17 11:04:54.737589 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-92d7fc68-c3cf-44cf-838f-c8c1eddff6cd req-afc0af2e-ac7e-48cd-9447-ee5d06fe0b85 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733263 Jun 17 11:04:54.752397 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d257ecbe-175e-42dc-a137-5d4d007383fc req-eb1c8630-ef6f-493e-ba2f-10e7219e65cb service neutron] 10.222.0.25 "GET /v2.0/networks/ac073896-1dc1-4a1c-bbb5-f73d05a0f328?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1386459 Jun 17 11:04:55.897104 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d050f5cf-ef4f-405b-8606-f75d748d6d8b req-ac1993a2-379a-4e2f-b8ad-44453b3a2c35 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:55.898581 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d050f5cf-ef4f-405b-8606-f75d748d6d8b req-ac1993a2-379a-4e2f-b8ad-44453b3a2c35 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0700042 Jun 17 11:04:55.917520 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72aa2069-7a5d-4171-bdb6-57e35ff93bbf req-9f5ead87-5ffa-47e8-b5c5-ecacbc0142d3 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:55.919146 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-72aa2069-7a5d-4171-bdb6-57e35ff93bbf req-9f5ead87-5ffa-47e8-b5c5-ecacbc0142d3 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 944 time: 0.0656130 Jun 17 11:04:55.940682 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d050f5cf-ef4f-405b-8606-f75d748d6d8b req-2e851076-e070-477d-a69d-bb01d5dc97a0 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0359957 Jun 17 11:04:55.962441 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-72aa2069-7a5d-4171-bdb6-57e35ff93bbf req-f12ecf70-58f0-445e-8b8d-ce5f3718b38f tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369451 Jun 17 11:04:56.799774 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:57.111600 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10690dd0-e25a-48fa-8417-b0f91140b38e req-1a3f6be5-61e9-4921-a7e5-625530d0808d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:57.113094 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-10690dd0-e25a-48fa-8417-b0f91140b38e req-1a3f6be5-61e9-4921-a7e5-625530d0808d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0628111 Jun 17 11:04:57.139909 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d4d0ea2-17fa-4799-8404-c6ce64bb8602 req-0c5d17ad-ecd5-4c0e-8453-e77da563aae6 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:57.141567 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0d4d0ea2-17fa-4799-8404-c6ce64bb8602 req-0c5d17ad-ecd5-4c0e-8453-e77da563aae6 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 944 time: 0.0649233 Jun 17 11:04:57.152588 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-10690dd0-e25a-48fa-8417-b0f91140b38e req-809a6a5f-bc2b-49ae-82fe-a61d94c713ce tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329037 Jun 17 11:04:57.184808 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0d4d0ea2-17fa-4799-8404-c6ce64bb8602 req-c15ce082-0c40-4885-a57c-4e9f0e1a849f tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0359344 Jun 17 11:04:58.326119 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb2435d-0937-448a-b0da-7d9d4c4c696f req-56545d03-7437-4b34-a29d-d6f6959f27be tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:58.327570 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3cb2435d-0937-448a-b0da-7d9d4c4c696f req-56545d03-7437-4b34-a29d-d6f6959f27be tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0645418 Jun 17 11:04:58.364908 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b56f586-83cc-4a8a-8f00-728603f2421a req-83aa1fdb-c6ea-41ed-92f4-40d7e2ce4ab3 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:58.366419 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9b56f586-83cc-4a8a-8f00-728603f2421a req-83aa1fdb-c6ea-41ed-92f4-40d7e2ce4ab3 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 944 time: 0.0698750 Jun 17 11:04:58.372992 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3cb2435d-0937-448a-b0da-7d9d4c4c696f req-1e7d5048-da9a-4e78-9773-a300ac3c1b0c tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/security-groups?id=e2a6f543-62c5-454b-b738-e39aef4a6ff1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391281 Jun 17 11:04:58.406471 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9b56f586-83cc-4a8a-8f00-728603f2421a req-57b581f3-4f87-478c-88b8-b1f444e20ad3 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340798 Jun 17 11:04:58.874048 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 6f120683-9585-46d0-bfd8-a6c28bf5562f details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:04:58.946834 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ed75759-619b-4bd3-ad0f-18b0f868f462 req-403b907f-3728-4c96-864a-ce35a481f6b2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:58.948223 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6ed75759-619b-4bd3-ad0f-18b0f868f462 req-403b907f-3728-4c96-864a-ce35a481f6b2 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 945 time: 0.0645273 Jun 17 11:04:58.969892 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 6f120683-9585-46d0-bfd8-a6c28bf5562f, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=6f120683-9585-46d0-bfd8-a6c28bf5562f,segment=NetworkSegment(b30833e2-269b-473f-8667-473b40248da0),segment_id=b30833e2-269b-473f-8667-473b40248da0)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:04:58.981819 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '6f120683-9585-46d0-bfd8-a6c28bf5562f', 'network_id': 'ac073896-1dc1-4a1c-bbb5-f73d05a0f328', 'port_id': '6f120683-9585-46d0-bfd8-a6c28bf5562f', 'mac_address': 'fa:16:3e:48:92:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 115, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4f767ce8-3cfb-498b-9928-86e92efe06d9', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:04:59.024258 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:59.039704 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6f120683-9585-46d0-bfd8-a6c28bf5562f {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:04:59.054499 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-6ed75759-619b-4bd3-ad0f-18b0f868f462 req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Deleting port 2ec3e896-70d1-4c47-933b-7234e4f744ed {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:04:59.055077 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-6ed75759-619b-4bd3-ad0f-18b0f868f462 req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:59.059920 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 6f120683-9585-46d0-bfd8-a6c28bf5562f, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=6f120683-9585-46d0-bfd8-a6c28bf5562f,segment=NetworkSegment(b30833e2-269b-473f-8667-473b40248da0),segment_id=b30833e2-269b-473f-8667-473b40248da0)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:04:59.125638 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:59.128646 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:59.152185 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-6ed75759-619b-4bd3-ad0f-18b0f868f462 req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] For port 2ec3e896-70d1-4c47-933b-7234e4f744ed, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=2ec3e896-70d1-4c47-933b-7234e4f744ed,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:04:59.152185 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-6ed75759-619b-4bd3-ad0f-18b0f868f462 req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:59.178458 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=6f120683-9585-46d0-bfd8-a6c28bf5562f,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:59.181965 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:59.218618 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-6ed75759-619b-4bd3-ad0f-18b0f868f462 req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Calling delete_port for 2ec3e896-70d1-4c47-933b-7234e4f744ed owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:04:59.416907 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-6ed75759-619b-4bd3-ad0f-18b0f868f462 req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:59.422133 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:04:59.430480 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['2ec3e896-70d1-4c47-933b-7234e4f744ed'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:04:59.452789 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Pushing event deleted for resources: {'Port': ['ID=2ec3e896-70d1-4c47-933b-7234e4f744ed,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:04:59.476420 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.476882 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.477340 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.477708 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.478066 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.478418 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.478767 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.479147 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.479494 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.479838 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.480182 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.480528 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:04:59.485530 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:04:59.519247 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['6f120683-9585-46d0-bfd8-a6c28bf5562f'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:04:59.523586 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-6ed75759-619b-4bd3-ad0f-18b0f868f462 req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] No DVR routers for this DVR port 2ec3e896-70d1-4c47-933b-7234e4f744ed on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:04:59.526180 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-6ed75759-619b-4bd3-ad0f-18b0f868f462 req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:04:59.528484 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6ed75759-619b-4bd3-ad0f-18b0f868f462 req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.25 "DELETE /v2.0/ports/2ec3e896-70d1-4c47-933b-7234e4f744ed HTTP/1.1" status: 204 len: 173 time: 0.5727837 Jun 17 11:04:59.529075 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a1113dd8-dbb2-4892-8625-6d6a3fdd1289', 'name': 'network-vif-deleted', 'tag': '2ec3e896-70d1-4c47-933b-7234e4f744ed'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:04:59.531507 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f2af4727-be73-4608-93e2-3c844b79de5a" -d '{"events": [{"server_uuid": "a1113dd8-dbb2-4892-8625-6d6a3fdd1289", "name": "network-vif-deleted", "tag": "2ec3e896-70d1-4c47-933b-7234e4f744ed"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:04:59.532799 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3447a190-a5bf-45c7-a67e-eaee02f0721f req-9bf45dfa-1898-49b7-8d3b-57592e987577 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 210 time: 0.0328894 Jun 17 11:04:59.584788 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:04:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de270002-d57f-4c19-8025-cddc31ac6077 x-openstack-request-id: req-de270002-d57f-4c19-8025-cddc31ac6077 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:04:59.585152 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a1113dd8-dbb2-4892-8625-6d6a3fdd1289", "name": "network-vif-deleted", "tag": "2ec3e896-70d1-4c47-933b-7234e4f744ed", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:04:59.585473 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-de270002-d57f-4c19-8025-cddc31ac6077 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:04:59.585902 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a1113dd8-dbb2-4892-8625-6d6a3fdd1289', 'name': 'network-vif-deleted', 'tag': '2ec3e896-70d1-4c47-933b-7234e4f744ed', 'status': 'completed', 'code': 200} Jun 17 11:04:59.611260 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ac901f-2958-4acc-b4eb-8cade3912476 req-66fcf5f2-43f4-44ae-a8e4-5c716fe5e21a tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:04:59.613227 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-92ac901f-2958-4acc-b4eb-8cade3912476 req-66fcf5f2-43f4-44ae-a8e4-5c716fe5e21a tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 945 time: 0.0777664 Jun 17 11:04:59.658941 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-92ac901f-2958-4acc-b4eb-8cade3912476 req-b82a2a7b-bd3b-48e7-b7fe-c332c794c9df tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383711 Jun 17 11:05:00.722620 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7b74e923-b759-4bfb-8bf6-f66b86036008 req-8fff012f-c7e1-40e2-90e1-f18ab86b0c60 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1113dd8-dbb2-4892-8625-6d6a3fdd1289 HTTP/1.1" status: 200 len: 210 time: 0.0440764 Jun 17 11:05:00.856956 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bef2b2f0-85aa-4cdf-88ea-dfe45283a760 req-42c3ed50-b854-45aa-a110-f8ba4d9d576a tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:00.858409 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bef2b2f0-85aa-4cdf-88ea-dfe45283a760 req-42c3ed50-b854-45aa-a110-f8ba4d9d576a tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 945 time: 0.0677354 Jun 17 11:05:00.871921 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 6f120683-9585-46d0-bfd8-a6c28bf5562f up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:05:00.899182 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bef2b2f0-85aa-4cdf-88ea-dfe45283a760 req-833ea340-0ee0-4e2b-badb-3802a3998fcd tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340545 Jun 17 11:05:00.960410 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 6f120683-9585-46d0-bfd8-a6c28bf5562f completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:05:00.964651 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 6f120683-9585-46d0-bfd8-a6c28bf5562f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:00.971836 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:01.050669 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:01.073928 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ebf62d4-7f7c-4434-a11c-4d42d419c7d7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f120683-9585-46d0-bfd8-a6c28bf5562f'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:05:01.076181 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-710e9924-4808-48d2-ade1-2ac68dd654b1" -d '{"events": [{"server_uuid": "4ebf62d4-7f7c-4434-a11c-4d42d419c7d7", "name": "network-vif-plugged", "status": "completed", "tag": "6f120683-9585-46d0-bfd8-a6c28bf5562f"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:05:01.091569 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 6f120683-9585-46d0-bfd8-a6c28bf5562f, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=6f120683-9585-46d0-bfd8-a6c28bf5562f,segment=NetworkSegment(b30833e2-269b-473f-8667-473b40248da0),segment_id=b30833e2-269b-473f-8667-473b40248da0)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:05:01.166085 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:01.167524 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:01.192303 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:05:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-735592d5-1cad-4706-a2d6-f93f9b04bdc9 x-openstack-request-id: req-735592d5-1cad-4706-a2d6-f93f9b04bdc9 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:05:01.193122 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ebf62d4-7f7c-4434-a11c-4d42d419c7d7", "name": "network-vif-plugged", "status": "completed", "tag": "6f120683-9585-46d0-bfd8-a6c28bf5562f", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:05:01.193403 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-735592d5-1cad-4706-a2d6-f93f9b04bdc9 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:05:01.193799 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ebf62d4-7f7c-4434-a11c-4d42d419c7d7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f120683-9585-46d0-bfd8-a6c28bf5562f', 'code': 200} Jun 17 11:05:01.219580 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=6f120683-9585-46d0-bfd8-a6c28bf5562f,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:01.223122 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:01.541777 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726ed83c-78f9-45cc-921e-94c55890553e req-30e97dcc-d7dc-482f-86ab-ea79817d507a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:01.543193 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-726ed83c-78f9-45cc-921e-94c55890553e req-30e97dcc-d7dc-482f-86ab-ea79817d507a service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 1099 time: 0.0517507 Jun 17 11:05:01.577921 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-726ed83c-78f9-45cc-921e-94c55890553e req-63f429ae-e4db-436c-bbf6-a452acd5182b service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0272505 Jun 17 11:05:01.818081 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38786) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:02.151481 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f66b9a04-4c20-4f9d-b023-dd221b26d6e7 req-766e6e63-52be-4640-83e6-d26d9808976a tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:02.152945 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f66b9a04-4c20-4f9d-b023-dd221b26d6e7 req-766e6e63-52be-4640-83e6-d26d9808976a tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 946 time: 0.1362789 Jun 17 11:05:02.217188 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f66b9a04-4c20-4f9d-b023-dd221b26d6e7 req-f3c1d9ff-0491-4eb7-8967-d67b572cecfa tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0577774 Jun 17 11:05:02.306222 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8355326'] for router_interface, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:02.588094 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] Deleting port 02e7db95-341e-4786-900e-6475e19dcf9f {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:05:02.588094 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:02.664740 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] For port 02e7db95-341e-4786-900e-6475e19dcf9f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=02e7db95-341e-4786-900e-6475e19dcf9f,segment=NetworkSegment(681b6bae-a040-4fca-ac88-d21e40353a83),segment_id=681b6bae-a040-4fca-ac88-d21e40353a83)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:05:02.665244 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:02.731593 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] Calling delete_port for 02e7db95-341e-4786-900e-6475e19dcf9f owned by network:router_interface {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:05:02.888517 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 2ec3e896-70d1-4c47-933b-7234e4f744ed no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:05:02.908811 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 2ec3e896-70d1-4c47-933b-7234e4f744ed {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:05:02.914685 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 2ec3e896-70d1-4c47-933b-7234e4f744ed not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:05:03.016903 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:03.019923 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:03.045397 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] Pushing event deleted for resources: {'Port': ['ID=02e7db95-341e-4786-900e-6475e19dcf9f,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:03.048777 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:03.213096 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7899567', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8355178'] for router_interface, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:03.413597 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9b0cf6-1baa-4e80-beb1-53beca047c94 req-5fe262c9-28f9-4719-97dd-62416f17346e tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:03.415220 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5b9b0cf6-1baa-4e80-beb1-53beca047c94 req-5fe262c9-28f9-4719-97dd-62416f17346e tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 946 time: 0.0822420 Jun 17 11:05:03.452248 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] Router 20434bf8-2076-49d9-bb15-5bae741fb5d9 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:05:03.455572 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5b9b0cf6-1baa-4e80-beb1-53beca047c94 req-5f2594c7-dfda-4a5b-bc0a-49308d21e515 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311928 Jun 17 11:05:03.782908 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:05:03.789956 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-2e7990cb-dbb7-4100-b825-4616df39a524 admin admin] 10.222.0.41 "PUT /v2.0/routers/20434bf8-2076-49d9-bb15-5bae741fb5d9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9692309 Jun 17 11:05:03.791065 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38802) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:03.793959 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edc29867-b34c-45e1-8ebd-30ec0acea964 None None] Sync routers for ids ['20434bf8-2076-49d9-bb15-5bae741fb5d9'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:05:03.808585 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edc29867-b34c-45e1-8ebd-30ec0acea964 None None] Routers {'20434bf8-2076-49d9-bb15-5bae741fb5d9'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:05:03.809249 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-edc29867-b34c-45e1-8ebd-30ec0acea964 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:04:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20434bf8-2076-49d9-bb15-5bae741fb5d9'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:03.892433 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Notify callbacks [] for router, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:03.922192 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-edc29867-b34c-45e1-8ebd-30ec0acea964 None None] Set router 20434bf8-2076-49d9-bb15-5bae741fb5d9 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:05:03.992827 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:04.105314 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Deleting port dd156b67-a7cb-4ed4-9492-a0178bd94cbe {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:05:04.106381 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:04.127494 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-edc29867-b34c-45e1-8ebd-30ec0acea964 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-router', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81'}], 'enable_snat': True}, 'gw_port_id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:07Z', 'updated_at': '2021-06-17T11:05:02Z', 'revision_number': 5, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'gw_port': {'id': 'dd156b67-a7cb-4ed4-9492-a0178bd94cbe', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:e5:d7:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 267, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:08Z', 'updated_at': '2021-06-17T11:01:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:04.160817 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edc29867-b34c-45e1-8ebd-30ec0acea964 None None] Checking router: 20434bf8-2076-49d9-bb15-5bae741fb5d9 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:05:04.169278 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edc29867-b34c-45e1-8ebd-30ec0acea964 None None] Routers {'20434bf8-2076-49d9-bb15-5bae741fb5d9'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:05:04.169914 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-edc29867-b34c-45e1-8ebd-30ec0acea964 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:04:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20434bf8-2076-49d9-bb15-5bae741fb5d9'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:04.190370 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] For port dd156b67-a7cb-4ed4-9492-a0178bd94cbe, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=dd156b67-a7cb-4ed4-9492-a0178bd94cbe,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:05:04.193078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:04.254349 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-edc29867-b34c-45e1-8ebd-30ec0acea964 None None] Set router 20434bf8-2076-49d9-bb15-5bae741fb5d9 gateway port host: None {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:05:04.256976 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Calling delete_port for dd156b67-a7cb-4ed4-9492-a0178bd94cbe owned by network:router_gateway {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:05:04.309214 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-edc29867-b34c-45e1-8ebd-30ec0acea964 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-router', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:07Z', 'updated_at': '2021-06-17T11:05:03Z', 'revision_number': 6, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'gw_port_host': None}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:04.335270 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edc29867-b34c-45e1-8ebd-30ec0acea964 None None] The sync data for ids ['20434bf8-2076-49d9-bb15-5bae741fb5d9'] in dv-cinder-773870-6-iscsi is: [{'id': '20434bf8-2076-49d9-bb15-5bae741fb5d9', 'name': 'tempest-ServerRescueNegativeTestJSON-1087493407-router', 'tenant_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:07Z', 'updated_at': '2021-06-17T11:05:03Z', 'revision_number': 6, 'project_id': 'e007b664c6c24e02a6dea83a17dd1f6b', 'gw_port_host': None}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:05:04.519627 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:04.521736 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:04.545315 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Pushing event deleted for resources: {'Port': ['ID=dd156b67-a7cb-4ed4-9492-a0178bd94cbe,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:04.548987 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:04.619618 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8286505'] for router_gateway, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:04.737709 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8357994', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2026'] for router, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:04.742453 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:04.862588 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8291427'] for router, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:04.863168 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 20434bf8-2076-49d9-bb15-5bae741fb5d9 {{(pid=110214) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Jun 17 11:05:04.870592 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Notify callbacks [] for router, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:04.870592 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] 10.222.0.41 "DELETE /v2.0/routers/20434bf8-2076-49d9-bb15-5bae741fb5d9 HTTP/1.1" status: 204 len: 168 time: 1.0781822 Jun 17 11:05:04.873043 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38812) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:04.930431 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_v2 [None req-806d9fcb-80a9-46f4-874c-2b5e10a82cb3 admin admin] Deleting subnet ab7c7a9f-b422-4b40-b94a-6939be91bbb8 {{(pid=110214) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:05:04.933536 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-806d9fcb-80a9-46f4-874c-2b5e10a82cb3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:04.967161 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-806d9fcb-80a9-46f4-874c-2b5e10a82cb3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6228443'] for subnet, precommit_delete_associations {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:05.004751 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-806d9fcb-80a9-46f4-874c-2b5e10a82cb3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:05.125447 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-806d9fcb-80a9-46f4-874c-2b5e10a82cb3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6239301', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5530029'] for subnet, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:05.127983 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-72247979-dfc8-4e28-8d14-cc49c01afd64 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:05.157951 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-806d9fcb-80a9-46f4-874c-2b5e10a82cb3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ab7c7a9f-b422-4b40-b94a-6939be91bbb8,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:05.163607 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-806d9fcb-80a9-46f4-874c-2b5e10a82cb3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:05.164606 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-806d9fcb-80a9-46f4-874c-2b5e10a82cb3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:05.166463 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-806d9fcb-80a9-46f4-874c-2b5e10a82cb3 admin admin] 10.222.0.41 "DELETE /v2.0/subnets/ab7c7a9f-b422-4b40-b94a-6939be91bbb8 HTTP/1.1" status: 204 len: 168 time: 0.2925169 Jun 17 11:05:05.171138 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38816) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:05.238323 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:05.322927 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:05.337440 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0fe823e2-06dd-4212-84a6-8e0beda57580']}} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:05.351582 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '681b6bae-a040-4fca-ac88-d21e40353a83') {'for_net_delete': True} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:05.351844 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '681b6bae-a040-4fca-ac88-d21e40353a83') {} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:05.361416 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6228436'] for segment, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:05.377541 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:05.385403 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Releasing vlan 139 on physical network physnet1 to pool {{(pid=110214) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:05:05.385802 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6239464'] for segment, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: retrieve_revision_numbers = { Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: retrieve_revision_numbers = { Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: retrieve_revision_numbers = { Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: Traceback (most recent call last): Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: timer() Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: cb(*args, **kw) Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: return func(*args, **kwargs) Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: self._notify() Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: self.callback(batched_events) Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: event.method(event) Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: return f(self, *a, **k) Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._get(url).json() Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: return self.request(url, 'GET', **kwargs) Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:05:05.387522 dv-cinder-773870-6-iscsi neutron-server[110214]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:05:05.531379 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:05.535182 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:05.537741 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:05.544056 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] 10.222.0.41 "DELETE /v2.0/networks/0fe823e2-06dd-4212-84a6-8e0beda57580 HTTP/1.1" status: 204 len: 168 time: 0.3694215 Jun 17 11:05:05.550203 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Pushing event deleted for resources: {'Network': ['ID=0fe823e2-06dd-4212-84a6-8e0beda57580,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:05.557604 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.557986 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.558353 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.558715 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.559098 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.559454 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.559819 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.560161 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.560536 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.560889 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.561238 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.561666 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:05.564820 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:05.908792 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38824) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:05.951276 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-65461ec6-9854-4f89-bbe8-53a1f5f18c2b admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=e007b664c6c24e02a6dea83a17dd1f6b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0411727 Jun 17 11:05:05.953511 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38826) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:06.000262 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9643db39-ddb3-4ba5-8533-1ac28f8ad481 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:06.020922 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9643db39-ddb3-4ba5-8533-1ac28f8ad481 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:06.093788 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device dd156b67-a7cb-4ed4-9492-a0178bd94cbe no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:05:06.114748 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: dd156b67-a7cb-4ed4-9492-a0178bd94cbe {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:05:06.115123 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device dd156b67-a7cb-4ed4-9492-a0178bd94cbe not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:05:06.115548 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 02e7db95-341e-4786-900e-6475e19dcf9f no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:05:06.136564 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 02e7db95-341e-4786-900e-6475e19dcf9f {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:05:06.136917 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 02e7db95-341e-4786-900e-6475e19dcf9f not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:05:06.148456 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9643db39-ddb3-4ba5-8533-1ac28f8ad481 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:06.151117 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9643db39-ddb3-4ba5-8533-1ac28f8ad481 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:06.152902 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-9643db39-ddb3-4ba5-8533-1ac28f8ad481 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/e2a6f543-62c5-454b-b738-e39aef4a6ff1 HTTP/1.1" status: 204 len: 168 time: 0.1978867 Jun 17 11:05:06.153089 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-aa861586-c988-4846-9bd5-ee5995008259 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:06.160611 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9643db39-ddb3-4ba5-8533-1ac28f8ad481 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2a6f543-62c5-454b-b738-e39aef4a6ff1,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:06.164363 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9643db39-ddb3-4ba5-8533-1ac28f8ad481 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:07.218315 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38852) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:07.312054 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-network', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:05:07.422503 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Made reservation on behalf of e96eb64d17bd425d9b0a15bc07c55136 for: {'network': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:05:07.425002 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:07.433820 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:07.523420 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:07.594056 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:07.598199 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-38ba5fbb-9df7-4af7-a66c-eead43371879 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:07.611410 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:07.626325 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] vlan segment allocate from pool success with {'vlan_id': 116, 'physical_network': 'physnet1'} {{(pid=110214) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 11:05:07.635203 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f3cf50f-e16f-47f6-b58a-29f6d9c4ab3f,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:07.639791 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:07.642528 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:07.642889 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.segments_db [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Added segment a39bef7f-0015-4ba7-8bea-9565729cbb43 of type vlan for network 68556f75-deee-4c64-96a7-37433fd16432 Jun 17 11:05:07.691067 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:07.782268 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:07.783636 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:07.784219 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:07.786889 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:07.843118 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Pushing event updated for resources: {'Network': ['ID=68556f75-deee-4c64-96a7-37433fd16432,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:07.845916 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:07.853314 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network 68556f75-deee-4c64-96a7-37433fd16432 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 11:05:07.857315 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.6378713 Jun 17 11:05:07.860360 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38860) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:07.868498 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Request body: {'subnet': {'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-subnet', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:05:07.930804 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Made reservation on behalf of e96eb64d17bd425d9b0a15bc07c55136 for: {'subnet': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:05:07.933518 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5529992'] for subnet, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:08.165537 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6239242', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5530010'] for subnet, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:08.167953 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-806d9fcb-80a9-46f4-874c-2b5e10a82cb3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:08.213189 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Pushing event updated for resources: {'Subnet': ['ID=2af00aea-d778-4108-9ac2-b4c1362392ec,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:08.219635 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:08.228208 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Checking segment: {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110214) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:05:08.228561 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Network hostable DHCP agents. Network: 68556f75-deee-4c64-96a7-37433fd16432, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110214) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 11:05:08.330474 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Network 68556f75-deee-4c64-96a7-37433fd16432 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110214) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 11:05:08.411686 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, 68556f75-deee-4c64-96a7-37433fd16432) {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:05:08.416520 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:08.416520 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:08.421268 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9f22f71-d5d8-4138-bb4a-7501824e1ea8 None None] Network 68556f75-deee-4c64-96a7-37433fd16432 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:05:08.486630 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-19d9db6d-db1e-4674-943f-b1e380f6515d admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.6247196 Jun 17 11:05:08.489848 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38862) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:08.494310 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:05:08.562342 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5498e9f9-7e24-5c53-b771-9493a76e3e58-68556f75-deee-4c64-96a7-37433fd16432', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec'}]}} from dv-cinder-773870-6-iscsi. {{(pid=110216) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Jun 17 11:05:08.563284 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:08.570814 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8358582', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1816'] for router, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:08.571929 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8357919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8287158', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-8346348', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2019'] for router, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:08.626999 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:08.702877 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.db_base_plugin_common [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Allocated IP 172.20.0.2 (68556f75-deee-4c64-96a7-37433fd16432/2af00aea-d778-4108-9ac2-b4c1362392ec/ee69616f-d3d6-487f-beab-300cabda1d0f) {{(pid=110216) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:05:08.847057 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8287140', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8358552', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2037'] for router, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:08.851654 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Notify callbacks [] for port, precommit_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:08.860303 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Transition to ACTIVE for port object ee69616f-d3d6-487f-beab-300cabda1d0f will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:05:08.874413 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Transition to ACTIVE for port object ee69616f-d3d6-487f-beab-300cabda1d0f will not be triggered until provisioned by entity DHCP. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:05:08.949024 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:08.950910 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-276011e1-a940-4234-9c70-7451fd3dd31b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:08.987154 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Network 68556f75-deee-4c64-96a7-37433fd16432 is already hosted by enough agents. {{(pid=110216) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:05:08.990135 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.base_scheduler [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Resources bound (agent type, host, resource id): {{(pid=110216) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:05:08.995868 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Received port after_create {{(pid=110216) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:05:09.002524 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Pushing event updated for resources: {'Port': ['ID=ee69616f-d3d6-487f-beab-300cabda1d0f,revision_number=1']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:09.007315 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:09.056962 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Attempting to bind port ee69616f-d3d6-487f-beab-300cabda1d0f on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:05:09.057336 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Attempting to bind port ee69616f-d3d6-487f-beab-300cabda1d0f by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:05:09.057708 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Attempting to bind port ee69616f-d3d6-487f-beab-300cabda1d0f on network 68556f75-deee-4c64-96a7-37433fd16432 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:05:09.062714 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 4, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:05:09.063123 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Checking segment: {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:05:09.063574 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:09.063976 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Bound using segment: {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:05:09.064443 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Bound port: ee69616f-d3d6-487f-beab-300cabda1d0f, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:05:09.064821 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:09.100359 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:09.118295 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:09.125849 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] For port ee69616f-d3d6-487f-beab-300cabda1d0f, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:05:09.128928 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] For port ee69616f-d3d6-487f-beab-300cabda1d0f, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=ee69616f-d3d6-487f-beab-300cabda1d0f,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:05:09.212365 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:09.215126 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:09.222364 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Allocated IP 172.27.3.95 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/512d31d3-8533-49cd-b207-ad06c26ab2db) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:05:09.287171 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Pushing event updated for resources: {'Port': ['ID=ee69616f-d3d6-487f-beab-300cabda1d0f,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:09.296774 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:09.336455 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:09.446430 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:09.448740 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:09.488937 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:05:09.494746 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:05:09.499493 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:05:09.502635 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Pushing event updated for resources: {'Port': ['ID=512d31d3-8533-49cd-b207-ad06c26ab2db,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:09.522964 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:09.836053 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:10.146540 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device ee69616f-d3d6-487f-beab-300cabda1d0f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:05:10.222465 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2931cc46-41ea-472f-9b45-0b2991d12250 None None] Network 68556f75-deee-4c64-96a7-37433fd16432 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:05:10.268725 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8358543', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8287186'] for router, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:10.282933 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port ee69616f-d3d6-487f-beab-300cabda1d0f completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:05:10.451484 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-3ac3614e-f993-4cb1-9ec1-893fead06411 None None] Provisioning for port ee69616f-d3d6-487f-beab-300cabda1d0f completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:05:10.461016 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-3ac3614e-f993-4cb1-9ec1-893fead06411 None None] Provisioning complete for port ee69616f-d3d6-487f-beab-300cabda1d0f triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:10.461333 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3ac3614e-f993-4cb1-9ec1-893fead06411 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:10.519754 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Router a0be9488-bc15-4149-b213-8c5540303580 is scheduled to L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 with binding_index 1 {{(pid=110214) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} Jun 17 11:05:10.574589 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3ac3614e-f993-4cb1-9ec1-893fead06411 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:10.609830 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-3ac3614e-f993-4cb1-9ec1-893fead06411 None None] For port ee69616f-d3d6-487f-beab-300cabda1d0f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=ee69616f-d3d6-487f-beab-300cabda1d0f,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:05:10.625592 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:05:10.636480 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Sync routers for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:05:10.646838 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:05:10.646838 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:04:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:10.709302 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3ac3614e-f993-4cb1-9ec1-893fead06411 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:10.723499 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:10.730926 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] Notify callbacks [] for router, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:10.730926 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-bb624099-af78-4ef6-94fb-51fef7bdcd37 admin admin] 10.222.0.41 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 2.2365041 Jun 17 11:05:10.730926 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38876) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:10.816779 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:05:10.819187 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac3614e-f993-4cb1-9ec1-893fead06411 None None] Pushing event updated for resources: {'Port': ['ID=ee69616f-d3d6-487f-beab-300cabda1d0f,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:10.845665 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-3ac3614e-f993-4cb1-9ec1-893fead06411 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:10.905857 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-47735625-4b75-47db-a53f-412d814d774f None None] Provisioning complete for port ee69616f-d3d6-487f-beab-300cabda1d0f triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:10.906238 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-47735625-4b75-47db-a53f-412d814d774f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.063947 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:09Z', 'revision_number': 3, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:11.090161 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Checking router: a0be9488-bc15-4149-b213-8c5540303580 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:05:11.090426 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Updating router a0be9488-bc15-4149-b213-8c5540303580 port 512d31d3-8533-49cd-b207-ad06c26ab2db binding host dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:05:11.128456 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.168670 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.326193 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Allocated IP 172.20.0.1 (68556f75-deee-4c64-96a7-37433fd16432/2af00aea-d778-4108-9ac2-b4c1362392ec/753daf15-efa7-44ee-bf2d-02e931a5402f) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:05:11.383083 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Notify callbacks [] for port, precommit_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.392705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Transition to ACTIVE for port object 512d31d3-8533-49cd-b207-ad06c26ab2db will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:05:11.424041 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.437184 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.provisioning_blocks [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Transition to ACTIVE for port object 753daf15-efa7-44ee-bf2d-02e931a5402f will not be triggered until provisioned by entity DHCP. {{(pid=110214) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:05:11.479759 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.481794 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:11.531670 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27faf0d1-2f05-464b-9cbc-af1562788a9f None None] Pushing event updated for resources: {'Port': ['ID=512d31d3-8533-49cd-b207-ad06c26ab2db,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:11.533890 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Attempting to bind port 512d31d3-8533-49cd-b207-ad06c26ab2db on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:05:11.534270 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Attempting to bind port 512d31d3-8533-49cd-b207-ad06c26ab2db by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:05:11.534640 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Attempting to bind port 512d31d3-8533-49cd-b207-ad06c26ab2db on network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:05:11.537760 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.538094 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-27faf0d1-2f05-464b-9cbc-af1562788a9f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:11.539788 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:11.540829 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 4, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:05:11.541172 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Checking segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:05:11.541584 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.541980 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Bound using segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:05:11.542570 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Bound port: 512d31d3-8533-49cd-b207-ad06c26ab2db, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:05:11.542974 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.578087 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Network 68556f75-deee-4c64-96a7-37433fd16432 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:05:11.582703 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:05:11.585292 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:05:11.595870 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] For port 512d31d3-8533-49cd-b207-ad06c26ab2db, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:05:11.599649 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] For port 512d31d3-8533-49cd-b207-ad06c26ab2db, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=512d31d3-8533-49cd-b207-ad06c26ab2db,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:05:11.613665 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Pushing event updated for resources: {'Port': ['ID=753daf15-efa7-44ee-bf2d-02e931a5402f,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:11.617893 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:11.633698 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8290659'] for router_interface, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.652800 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.656904 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:11.746906 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:05:11.747946 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:04:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:11.750680 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27faf0d1-2f05-464b-9cbc-af1562788a9f None None] Pushing event updated for resources: {'Port': ['ID=512d31d3-8533-49cd-b207-ad06c26ab2db,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:11.756572 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-27faf0d1-2f05-464b-9cbc-af1562788a9f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:11.859143 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:11.883846 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:05:12.019510 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:12.038311 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-05e4f56d-c306-4aee-9777-4cefad241288 None None] Provisioning for port 753daf15-efa7-44ee-bf2d-02e931a5402f completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:05:12.045546 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-05e4f56d-c306-4aee-9777-4cefad241288 None None] Provisioning complete for port 753daf15-efa7-44ee-bf2d-02e931a5402f triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:12.045658 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-05e4f56d-c306-4aee-9777-4cefad241288 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:12.089192 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-05e4f56d-c306-4aee-9777-4cefad241288 None None] Port 753daf15-efa7-44ee-bf2d-02e931a5402f cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:05:12.101958 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:09Z', 'revision_number': 3, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:12.109309 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device ee69616f-d3d6-487f-beab-300cabda1d0f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:05:12.119774 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:12.123090 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-214b8103-ac6a-4850-b65d-cb87c1b3b920 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:12.139242 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0a9f73f-721d-4bd2-ab87-505f98892f7a None None] The sync data for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi is: [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:09Z', 'revision_number': 3, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:05:12.189353 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Pushing event updated for resources: {'Port': ['ID=753daf15-efa7-44ee-bf2d-02e931a5402f,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:12.190435 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port ee69616f-d3d6-487f-beab-300cabda1d0f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:12.191136 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:12.194354 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:12.195394 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7899558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8290591'] for router_interface, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:12.316007 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Network 68556f75-deee-4c64-96a7-37433fd16432 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:05:12.317685 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:05:12.483579 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Router a0be9488-bc15-4149-b213-8c5540303580 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:05:12.613470 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:05:12.614249 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-73f45c3b-a996-44df-9ca8-bd251e8cbed1 None None] Provisioning complete for port 753daf15-efa7-44ee-bf2d-02e931a5402f triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:12.614734 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-73f45c3b-a996-44df-9ca8-bd251e8cbed1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:12.620645 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] 10.222.0.41 "PUT /v2.0/routers/a0be9488-bc15-4149-b213-8c5540303580/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8830349 Jun 17 11:05:12.654888 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-73f45c3b-a996-44df-9ca8-bd251e8cbed1 None None] Port 753daf15-efa7-44ee-bf2d-02e931a5402f cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:05:13.199415 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38896) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:13.204092 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-e8715c77-549b-46b2-abbe-f58b0e4c7a2e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1736347468', 'description': 'tempest-description--475828740'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:05:13.348821 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e8715c77-549b-46b2-abbe-f58b0e4c7a2e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:13.439973 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e8715c77-549b-46b2-abbe-f58b0e4c7a2e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:13.531258 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e8715c77-549b-46b2-abbe-f58b0e4c7a2e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:13.533764 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-eed35a39-5007-4c21-bd69-c14faed32a97 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:13.563399 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8715c77-549b-46b2-abbe-f58b0e4c7a2e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'SecurityGroup': ['ID=34b639cc-28f8-43be-a66a-93bad39c20f2,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:13.566209 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e8715c77-549b-46b2-abbe-f58b0e4c7a2e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:13.617430 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e8715c77-549b-46b2-abbe-f58b0e4c7a2e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:13.618791 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-e8715c77-549b-46b2-abbe-f58b0e4c7a2e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.4183662 Jun 17 11:05:13.621552 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38900) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:13.626080 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-799e692d-e5e7-4d4b-bd6f-848f8e3e318c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'security_group_rule': {'security_group_id': '34b639cc-28f8-43be-a66a-93bad39c20f2', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:05:13.731518 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-799e692d-e5e7-4d4b-bd6f-848f8e3e318c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:13.766772 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Sync routers for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:05:13.775510 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:05:13.776119 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:04:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:13.789694 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-799e692d-e5e7-4d4b-bd6f-848f8e3e318c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:13.874326 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-799e692d-e5e7-4d4b-bd6f-848f8e3e318c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:13.880360 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-09ad117e-b9e8-4922-8eef-cd2c82e251e1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:13.896606 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-799e692d-e5e7-4d4b-bd6f-848f8e3e318c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6af634c9-32bb-43ec-bc18-ab51991d8e83,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:13.900269 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-799e692d-e5e7-4d4b-bd6f-848f8e3e318c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:13.964715 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:05:13.976708 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-799e692d-e5e7-4d4b-bd6f-848f8e3e318c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:13.976708 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-799e692d-e5e7-4d4b-bd6f-848f8e3e318c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3445685 Jun 17 11:05:13.976708 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38904) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:13.976708 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-53ba9c82-6455-4f4b-a6e9-753ee3297c48 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'security_group_rule': {'security_group_id': '34b639cc-28f8-43be-a66a-93bad39c20f2', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:05:14.073742 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-53ba9c82-6455-4f4b-a6e9-753ee3297c48 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.141323 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-53ba9c82-6455-4f4b-a6e9-753ee3297c48 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.157822 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 512d31d3-8533-49cd-b207-ad06c26ab2db up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:05:14.173293 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 2, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:14.201026 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Checking router: a0be9488-bc15-4149-b213-8c5540303580 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:05:14.201385 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Updating router a0be9488-bc15-4149-b213-8c5540303580 port 753daf15-efa7-44ee-bf2d-02e931a5402f binding host dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:05:14.211409 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-53ba9c82-6455-4f4b-a6e9-753ee3297c48 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.218423 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-7150fcf1-a0ca-4f2d-9b81-6205a3fe9f30 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:14.231122 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ba9c82-6455-4f4b-a6e9-753ee3297c48 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=116aa48c-e521-4d3e-b071-748b8eef40f3,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:14.234269 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-53ba9c82-6455-4f4b-a6e9-753ee3297c48 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:14.234451 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.262999 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 512d31d3-8533-49cd-b207-ad06c26ab2db completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:05:14.267342 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 512d31d3-8533-49cd-b207-ad06c26ab2db triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:14.267717 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.352004 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.371754 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-53ba9c82-6455-4f4b-a6e9-753ee3297c48 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.378595 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-53ba9c82-6455-4f4b-a6e9-753ee3297c48 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4023590 Jun 17 11:05:14.379077 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 38914) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:14.384820 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'floatingip': {'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:05:14.405960 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 512d31d3-8533-49cd-b207-ad06c26ab2db, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=512d31d3-8533-49cd-b207-ad06c26ab2db,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:05:14.462238 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.464273 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:14.485662 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.538542 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Notify callbacks [] for port, precommit_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.549193 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.provisioning_blocks [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Transition to ACTIVE for port object 753daf15-efa7-44ee-bf2d-02e931a5402f will not be triggered until provisioned by entity L2. {{(pid=110218) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:05:14.602302 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.628866 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.631948 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=512d31d3-8533-49cd-b207-ad06c26ab2db,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:14.632338 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:14.635263 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:14.706098 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Pushing event updated for resources: {'Port': ['ID=753daf15-efa7-44ee-bf2d-02e931a5402f,revision_number=3']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:14.714423 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.714689 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.715049 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.715381 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.715709 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.716031 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.716362 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.716679 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.717000 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.717316 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.717632 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.717944 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:14.722784 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:14.723307 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Allocated IP 172.27.3.94 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/c6fff809-5cf0-4cf2-8f3b-5e0756989555) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:05:14.786296 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Attempting to bind port 753daf15-efa7-44ee-bf2d-02e931a5402f on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:05:14.786917 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Attempting to bind port 753daf15-efa7-44ee-bf2d-02e931a5402f by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:05:14.787053 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Attempting to bind port 753daf15-efa7-44ee-bf2d-02e931a5402f on network 68556f75-deee-4c64-96a7-37433fd16432 {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:05:14.797367 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 4, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:05:14.797971 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Checking segment: {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110218) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:05:14.798641 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.799275 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Bound using segment: {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:05:14.800027 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Bound port: 753daf15-efa7-44ee-bf2d-02e931a5402f, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'}}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:05:14.800625 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.863618 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.871725 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] For port 753daf15-efa7-44ee-bf2d-02e931a5402f, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110218) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:05:14.874898 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] For port 753daf15-efa7-44ee-bf2d-02e931a5402f, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=753daf15-efa7-44ee-bf2d-02e931a5402f,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110218) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:05:14.954703 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.957888 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:14.983073 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:14.987879 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0687d1ae-3120-4638-8ef8-d318f24ab46d tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:15.017496 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Pushing event updated for resources: {'Port': ['ID=753daf15-efa7-44ee-bf2d-02e931a5402f,revision_number=4']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:15.020158 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:05:15.020960 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:04:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:15.023224 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:15.031612 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'Port': ['ID=c6fff809-5cf0-4cf2-8f3b-5e0756989555,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:15.035657 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:15.048046 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:05:15.049544 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:05:15.055316 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:05:15.142733 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:05:15.148982 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:15.245195 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:15.359145 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:15.387063 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25111022-4822-4ff5-949f-0d576902a7cb None None] The sync data for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi is: [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:05:15.421567 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:15.502625 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:15.504771 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:15.578589 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'Port': ['ID=c6fff809-5cf0-4cf2-8f3b-5e0756989555,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:15.582245 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:15.590434 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:15.691692 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:15.693388 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.3124039 Jun 17 11:05:15.861388 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-025ebb30-3580-4d9b-a03e-1e34d64bd491 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?name=tempest-securitygroup--1736347468&fields=id&tenant_id=e96eb64d17bd425d9b0a15bc07c55136 HTTP/1.1" status: 200 len: 267 time: 0.0394590 Jun 17 11:05:15.978323 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-47b4e540-9e0c-4ae0-89f8-24722c103d88 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:15.980001 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-47b4e540-9e0c-4ae0-89f8-24722c103d88 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 817 time: 0.1114900 Jun 17 11:05:15.996464 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-f7f590ab-987f-4f25-810b-f0e23d4b6844 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/quotas/e96eb64d17bd425d9b0a15bc07c55136 HTTP/1.1" status: 200 len: 375 time: 0.0096452 Jun 17 11:05:16.088315 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-72e18493-fe69-4bc1-be66-3b94411a017e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0860591 Jun 17 11:05:16.195507 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 753daf15-efa7-44ee-bf2d-02e931a5402f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:05:16.264569 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-82575fef-31e3-4390-89fe-abadd0047e9e service neutron] 10.222.0.41 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1535552 Jun 17 11:05:16.362199 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9093c62b-3649-498e-a240-f879858f2faa service neutron] 10.222.0.41 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916016 Jun 17 11:05:16.383632 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 753daf15-efa7-44ee-bf2d-02e931a5402f completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:05:16.388431 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 753daf15-efa7-44ee-bf2d-02e931a5402f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:16.389279 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:16.487451 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:16.521385 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 753daf15-efa7-44ee-bf2d-02e931a5402f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=753daf15-efa7-44ee-bf2d-02e931a5402f,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:05:16.626159 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-520103c3-27bf-45af-a20f-ce24e268620f req-ad0937b5-b1b3-4b9f-b015-a5d393100d73 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 210 time: 0.0297508 Jun 17 11:05:16.628752 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:16.629759 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 512d31d3-8533-49cd-b207-ad06c26ab2db up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:05:16.632930 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:16.712712 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=753daf15-efa7-44ee-bf2d-02e931a5402f,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:16.717186 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:16.723749 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 512d31d3-8533-49cd-b207-ad06c26ab2db triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:16.724140 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:17.778968 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0cad72b4-4e2a-4eb8-b0c8-8da46382aedc req-b8da3751-dd1a-4a51-b5bb-94bb78ec588a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 210 time: 0.0318911 Jun 17 11:05:18.114495 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 753daf15-efa7-44ee-bf2d-02e931a5402f up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:05:18.160998 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 753daf15-efa7-44ee-bf2d-02e931a5402f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:18.165468 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:18.933293 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6f03012f-b1e7-44d4-a542-010fae022706 req-731ec6f8-735a-440e-81c0-172d8896d3a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 210 time: 0.0272591 Jun 17 11:05:19.389761 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-3ba3bfb8-8081-4b63-bd47-d241f0be1adc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:19.391129 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-3ba3bfb8-8081-4b63-bd47-d241f0be1adc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 817 time: 0.1064520 Jun 17 11:05:19.434042 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-3f2d7490-0d17-4b70-a6e4-c4e39845fa4b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e96eb64d17bd425d9b0a15bc07c55136 HTTP/1.1" status: 200 len: 380 time: 0.0334601 Jun 17 11:05:19.443233 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'port': {'device_id': '5c49d302-8c28-401f-b355-26568b700ec5', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'admin_state_up': True, 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'security_groups': ['34b639cc-28f8-43be-a66a-93bad39c20f2']}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:05:19.708423 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Made reservation on behalf of e96eb64d17bd425d9b0a15bc07c55136 for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:05:19.712655 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:19.836737 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Allocated IP 172.20.0.6 (68556f75-deee-4c64-96a7-37433fd16432/2af00aea-d778-4108-9ac2-b4c1362392ec/787f2fec-2d83-44f5-9283-874e16102ce0) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:05:19.973136 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:19.987502 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Transition to ACTIVE for port object 787f2fec-2d83-44f5-9283-874e16102ce0 will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:05:20.050161 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:05:20.079712 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a3264500-86f0-42ee-ac8c-223621c1482d req-93b265c1-22b7-48bf-bb27-17d63afd17d8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 210 time: 0.0284708 Jun 17 11:05:20.125772 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:20.129775 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f74266b1-115b-4c15-ae36-dcab2ca14bec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:20.168156 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Network 68556f75-deee-4c64-96a7-37433fd16432 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:05:20.171576 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:05:20.175283 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:05:20.209998 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'Port': ['ID=787f2fec-2d83-44f5-9283-874e16102ce0,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:20.215926 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:20.239392 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:20.240126 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:20.314999 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8752494 Jun 17 11:05:20.328114 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Request body: {'port': {'device_id': '5c49d302-8c28-401f-b355-26568b700ec5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:05:20.401400 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:20.474175 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-89261f86-d0bf-4d12-87be-474fbeaef553 None None] Provisioning for port 787f2fec-2d83-44f5-9283-874e16102ce0 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:05:20.479016 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-89261f86-d0bf-4d12-87be-474fbeaef553 None None] Provisioning complete for port 787f2fec-2d83-44f5-9283-874e16102ce0 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:20.479402 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-89261f86-d0bf-4d12-87be-474fbeaef553 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:20.514673 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-89261f86-d0bf-4d12-87be-474fbeaef553 None None] Port 787f2fec-2d83-44f5-9283-874e16102ce0 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:05:20.638459 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f38e53d0-5a47-4707-800f-984e751e00ee None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:20.667191 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 787f2fec-2d83-44f5-9283-874e16102ce0 {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:05:20.674542 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:20.685946 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Transition to ACTIVE for port object 787f2fec-2d83-44f5-9283-874e16102ce0 will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:05:20.742092 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:20.744202 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:20.815263 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Pushing event updated for resources: {'Port': ['ID=787f2fec-2d83-44f5-9283-874e16102ce0,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:20.820138 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:20.894060 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Attempting to bind port 787f2fec-2d83-44f5-9283-874e16102ce0 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:05:20.894388 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Attempting to bind port 787f2fec-2d83-44f5-9283-874e16102ce0 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:05:20.894677 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Attempting to bind port 787f2fec-2d83-44f5-9283-874e16102ce0 on network 68556f75-deee-4c64-96a7-37433fd16432 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:05:20.899301 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Port 787f2fec-2d83-44f5-9283-874e16102ce0 on network 68556f75-deee-4c64-96a7-37433fd16432 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:05:20.899610 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Attempting to bind port 787f2fec-2d83-44f5-9283-874e16102ce0 on network 68556f75-deee-4c64-96a7-37433fd16432 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:05:20.904599 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 5, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:05:20.904948 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Checking segment: {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:05:20.905314 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Bound using segment: {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:05:20.905740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Bound port: 787f2fec-2d83-44f5-9283-874e16102ce0, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:05:20.906087 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:20.969593 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:05:20.972468 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:05:21.034231 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:21.037721 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7d2d4ae5-1dc2-4341-9ee0-9939f4b5a068 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:21.068362 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:21.068971 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:21.070310 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] 10.222.0.25 "PUT /v2.0/ports/787f2fec-2d83-44f5-9283-874e16102ce0 HTTP/1.1" status: 200 len: 1093 time: 0.7465253 Jun 17 11:05:21.070804 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:05:21.073093 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e03199da-09bc-4221-ad24-2d2fd30bdb15" -d '{"events": [{"name": "network-changed", "server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:05:21.097895 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Pushing event updated for resources: {'Port': ['ID=787f2fec-2d83-44f5-9283-874e16102ce0,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:21.101869 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:21.114516 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:05:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f289fb9-3d58-4414-a062-293188a4d09c x-openstack-request-id: req-0f289fb9-3d58-4414-a062-293188a4d09c {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:05:21.115178 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:05:21.116043 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-0f289fb9-3d58-4414-a062-293188a4d09c {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:05:21.116540 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0', 'status': 'completed', 'code': 200} Jun 17 11:05:21.257011 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40e06d9d-9361-4db6-8f21-13a595738fcd req-a2ce72fd-8bc8-4f5c-9f24-16f8e4a0174a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:21.258532 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-40e06d9d-9361-4db6-8f21-13a595738fcd req-a2ce72fd-8bc8-4f5c-9f24-16f8e4a0174a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0628355 Jun 17 11:05:21.294392 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-40e06d9d-9361-4db6-8f21-13a595738fcd req-3f0e86d7-4468-4f8a-bce2-37c44e8130ec tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303597 Jun 17 11:05:22.471161 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a0e03ce-ab7c-4958-9ad6-8598361c1aa2 req-783d34f7-2563-4db2-be02-00a1929247d9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:22.472585 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9a0e03ce-ab7c-4958-9ad6-8598361c1aa2 req-783d34f7-2563-4db2-be02-00a1929247d9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0652246 Jun 17 11:05:22.509411 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9a0e03ce-ab7c-4958-9ad6-8598361c1aa2 req-f009c42f-fad1-4a92-845f-86eb0a8fc2ca tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307395 Jun 17 11:05:23.320204 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-99abfe1b-ac90-4a56-9b7c-564dd9374652 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:23.571601 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:23.686359 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093be3e2-3a48-4b6c-b89e-dbc735849b3d req-004820e0-a25d-48f9-8a1d-ac844dd7e9e9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:23.687896 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-093be3e2-3a48-4b6c-b89e-dbc735849b3d req-004820e0-a25d-48f9-8a1d-ac844dd7e9e9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0661633 Jun 17 11:05:23.725256 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-093be3e2-3a48-4b6c-b89e-dbc735849b3d req-266c3b8c-8c80-4f7d-869a-99121287cd4d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316591 Jun 17 11:05:24.473814 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:24.617159 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03199da-09bc-4221-ad24-2d2fd30bdb15 req-a00b4e51-2875-4550-8dd4-42f569f5a4ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:24.618608 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e03199da-09bc-4221-ad24-2d2fd30bdb15 req-a00b4e51-2875-4550-8dd4-42f569f5a4ea service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 1096 time: 0.0515893 Jun 17 11:05:24.907873 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48516bad-442d-4d8a-84c0-456b218ff8b2 req-4e566940-5b5c-4b7a-920e-29311d73e9dd tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:24.909237 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-48516bad-442d-4d8a-84c0-456b218ff8b2 req-4e566940-5b5c-4b7a-920e-29311d73e9dd tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0697315 Jun 17 11:05:24.945379 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-48516bad-442d-4d8a-84c0-456b218ff8b2 req-de793fa3-4d1e-4c12-a575-a41d572837f6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304842 Jun 17 11:05:25.116556 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03199da-09bc-4221-ad24-2d2fd30bdb15 req-246ea30a-ad1b-416e-a51a-c8625fd82cba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:25.121616 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e03199da-09bc-4221-ad24-2d2fd30bdb15 req-246ea30a-ad1b-416e-a51a-c8625fd82cba service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&shared=False HTTP/1.1" status: 200 len: 918 time: 0.0939825 Jun 17 11:05:25.220926 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03199da-09bc-4221-ad24-2d2fd30bdb15 req-ff16fab4-59f7-4619-846c-98db4d8f936f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:25.222356 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e03199da-09bc-4221-ad24-2d2fd30bdb15 req-ff16fab4-59f7-4619-846c-98db4d8f936f service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0979321 Jun 17 11:05:25.388461 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-f8323522-92ef-4086-8b8a-1ad1638e5413 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:25.389896 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-f8323522-92ef-4086-8b8a-1ad1638e5413 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 1096 time: 0.0512962 Jun 17 11:05:25.431815 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-5dd8a007-d811-4b4f-be0b-0e1326a8c37f service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=787f2fec-2d83-44f5-9283-874e16102ce0 HTTP/1.1" status: 200 len: 217 time: 0.0333068 Jun 17 11:05:25.480569 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-c7ee1010-2b96-4dda-a114-8347397b4fcb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:25.481889 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-c7ee1010-2b96-4dda-a114-8347397b4fcb service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0434096 Jun 17 11:05:25.546449 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-5cb20147-a95f-4c14-8025-fbd6d9b965bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:25.547926 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-5cb20147-a95f-4c14-8025-fbd6d9b965bc service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0579731 Jun 17 11:05:25.636092 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-f7b20a3f-bedc-424e-9e88-c4474d051787 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806150 Jun 17 11:05:25.726959 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5c9a9b92-dd2f-46a0-a01b-0841e1ffcde5 req-d1cf1334-46c6-46f4-8b42-fb74d75f6e60 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831516 Jun 17 11:05:26.130931 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fe0c35-e17c-48a1-8e65-68c5758c574b req-abd8c6ea-f64b-4327-a5f7-cee56c8d8b5a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:26.131719 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-59fe0c35-e17c-48a1-8e65-68c5758c574b req-abd8c6ea-f64b-4327-a5f7-cee56c8d8b5a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0671554 Jun 17 11:05:26.169589 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-59fe0c35-e17c-48a1-8e65-68c5758c574b req-1d9e7d36-837d-42b2-91d4-a9a2d837e2ae tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325799 Jun 17 11:05:26.822493 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:27.347789 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-298eaa0f-eed3-4ff0-94c6-2d63d2e2c72b req-c5202e29-9dbc-4935-add6-1f49b0255bec tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:27.349274 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-298eaa0f-eed3-4ff0-94c6-2d63d2e2c72b req-c5202e29-9dbc-4935-add6-1f49b0255bec tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0632272 Jun 17 11:05:27.385813 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-298eaa0f-eed3-4ff0-94c6-2d63d2e2c72b req-3cb53e51-6790-40aa-bf61-de02846ecd80 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303369 Jun 17 11:05:28.569004 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d1703f-6c34-4c6d-970a-3369846a435d req-10eddeb5-1a22-423a-ba71-8a1911234b01 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:28.571420 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-71d1703f-6c34-4c6d-970a-3369846a435d req-10eddeb5-1a22-423a-ba71-8a1911234b01 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0665915 Jun 17 11:05:28.612041 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-71d1703f-6c34-4c6d-970a-3369846a435d req-a0d9e9a8-768f-4110-a335-9f42fb0384cc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359852 Jun 17 11:05:28.687948 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39068) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:28.786192 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-171a78ee-d969-423d-94c1-b5c95376535d admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:28.870141 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-171a78ee-d969-423d-94c1-b5c95376535d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:28.914424 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-171a78ee-d969-423d-94c1-b5c95376535d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:28.917063 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9643db39-ddb3-4ba5-8533-1ac28f8ad481 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:28.952175 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-171a78ee-d969-423d-94c1-b5c95376535d admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=a35c68504e0a458cb5c14ea0ae14e009&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2631512 Jun 17 11:05:28.953211 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-171a78ee-d969-423d-94c1-b5c95376535d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f9e6585-edcf-41f5-baf1-bf455d3fd923,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:28.954917 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39072) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:28.956745 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-171a78ee-d969-423d-94c1-b5c95376535d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:29.002565 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e6df-5e0e-4911-a0f4-f4ac989585ba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:29.026499 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e6df-5e0e-4911-a0f4-f4ac989585ba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:29.136579 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e6df-5e0e-4911-a0f4-f4ac989585ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:29.139179 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e6df-5e0e-4911-a0f4-f4ac989585ba admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:29.140295 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-a2c7e6df-5e0e-4911-a0f4-f4ac989585ba admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/3f9e6585-edcf-41f5-baf1-bf455d3fd923 HTTP/1.1" status: 204 len: 168 time: 0.1843374 Jun 17 11:05:29.141041 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9f3db57c-5925-4da0-a592-bd58cc2dd7a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:29.145856 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 787f2fec-2d83-44f5-9283-874e16102ce0 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:05:29.149114 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2c7e6df-5e0e-4911-a0f4-f4ac989585ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f9e6585-edcf-41f5-baf1-bf455d3fd923,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:29.151492 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a2c7e6df-5e0e-4911-a0f4-f4ac989585ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:29.256877 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:05:29.266990 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '787f2fec-2d83-44f5-9283-874e16102ce0', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'port_id': '787f2fec-2d83-44f5-9283-874e16102ce0', 'mac_address': 'fa:16:3e:d7:aa:86', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:05:29.304619 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:29.321278 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 787f2fec-2d83-44f5-9283-874e16102ce0 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:05:29.341939 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:05:29.445289 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:29.447214 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:29.497579 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=787f2fec-2d83-44f5-9283-874e16102ce0,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:29.504705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.505057 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.505397 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.506234 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.506869 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.507265 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.507617 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.508005 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.508339 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.508663 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.509024 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.509346 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:05:29.513274 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:29.796955 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4afc63-7b3c-41cf-9c1c-e4c367a6e2a5 req-bd761e37-bd04-4c17-9a57-3fb9651a3bef tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:29.798528 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ea4afc63-7b3c-41cf-9c1c-e4c367a6e2a5 req-bd761e37-bd04-4c17-9a57-3fb9651a3bef tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 944 time: 0.0679641 Jun 17 11:05:29.838673 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ea4afc63-7b3c-41cf-9c1c-e4c367a6e2a5 req-3c39c454-bb05-4a78-88de-5cd12011b250 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0336945 Jun 17 11:05:29.889580 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['787f2fec-2d83-44f5-9283-874e16102ce0'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:05:31.046879 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be254830-5b2a-4c15-955f-17cadf940124 req-47802ae4-b40d-4701-8007-5e0c42201ca7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:31.049487 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-be254830-5b2a-4c15-955f-17cadf940124 req-47802ae4-b40d-4701-8007-5e0c42201ca7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 944 time: 0.0698290 Jun 17 11:05:31.092734 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-be254830-5b2a-4c15-955f-17cadf940124 req-51586b8b-be18-4d46-837f-29ce09eb408c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0324976 Jun 17 11:05:31.145943 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 787f2fec-2d83-44f5-9283-874e16102ce0 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:05:31.239802 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 787f2fec-2d83-44f5-9283-874e16102ce0 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:05:31.243758 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 787f2fec-2d83-44f5-9283-874e16102ce0 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:05:31.244264 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:31.324869 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:31.346427 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:05:31.348699 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d622910e-fca1-4122-a269-b7033627e127" -d '{"events": [{"server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "name": "network-vif-plugged", "status": "completed", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:05:31.363979 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:05:31.386898 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:05:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1a3f03cc-bffa-4b09-aabf-f0915942d498 x-openstack-request-id: req-1a3f03cc-bffa-4b09-aabf-f0915942d498 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:05:31.387196 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "name": "network-vif-plugged", "status": "completed", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:05:31.387453 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-1a3f03cc-bffa-4b09-aabf-f0915942d498 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:05:31.387849 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0', 'code': 200} Jun 17 11:05:31.446284 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:31.449147 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2658669d-fa3a-4438-a43a-6d5f5dcdd90c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:31.492742 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=787f2fec-2d83-44f5-9283-874e16102ce0,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:31.495611 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:31.718584 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47aaebc5-8354-4419-ad2a-15520947810f req-99615444-2fcd-4397-a7ed-dc96f8a70c88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:31.719981 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-47aaebc5-8354-4419-ad2a-15520947810f req-99615444-2fcd-4397-a7ed-dc96f8a70c88 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 1098 time: 0.0512619 Jun 17 11:05:31.753223 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-47aaebc5-8354-4419-ad2a-15520947810f req-c9c4ec1a-e6de-4f52-ace8-b12301199f69 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0262120 Jun 17 11:05:32.296890 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aada056-33e0-42a0-b094-0a005e568247 req-76003856-3bc4-412a-b10d-706bd5240301 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:32.298254 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6aada056-33e0-42a0-b094-0a005e568247 req-76003856-3bc4-412a-b10d-706bd5240301 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0657096 Jun 17 11:05:32.335121 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6aada056-33e0-42a0-b094-0a005e568247 req-8d836bc1-6527-4b27-925d-c07c3481aa28 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312369 Jun 17 11:05:32.811691 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b3ffbc-d298-44d0-b167-6cf4e029772d req-1ebdc85c-538b-4b46-a66e-b4143043b6ef tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:32.813154 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-77b3ffbc-d298-44d0-b167-6cf4e029772d req-1ebdc85c-538b-4b46-a66e-b4143043b6ef tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 946 time: 0.0651743 Jun 17 11:05:32.856419 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-77b3ffbc-d298-44d0-b167-6cf4e029772d req-434bf049-8b82-4e89-af4b-bc92284c5afc tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373728 Jun 17 11:05:33.515505 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cbc1d31-39a1-429e-9f91-683d1eadba79 req-29bca790-ac8d-47ad-bfdf-7769d1de0ae3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:33.516965 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4cbc1d31-39a1-429e-9f91-683d1eadba79 req-29bca790-ac8d-47ad-bfdf-7769d1de0ae3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0637221 Jun 17 11:05:33.555817 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4cbc1d31-39a1-429e-9f91-683d1eadba79 req-f4f685d8-806e-45b3-b79e-fc0aa591802a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0332043 Jun 17 11:05:34.037634 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ff89d5-e391-411a-bfbe-697df0860b8b req-bf0ab589-1bf1-4bb1-add2-580ff76e6ddf tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:34.039258 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b0ff89d5-e391-411a-bfbe-697df0860b8b req-bf0ab589-1bf1-4bb1-add2-580ff76e6ddf tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 946 time: 0.0627425 Jun 17 11:05:34.077862 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b0ff89d5-e391-411a-bfbe-697df0860b8b req-20c613fb-241d-4f0d-9933-111e4053910b tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327842 Jun 17 11:05:34.733074 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629b3072-39cc-42a0-a24d-bbb6ba8d41df req-f767b544-c48f-41b5-9145-ab8124ef09ce tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:34.734535 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-629b3072-39cc-42a0-a24d-bbb6ba8d41df req-f767b544-c48f-41b5-9145-ab8124ef09ce tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0655587 Jun 17 11:05:34.772205 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-629b3072-39cc-42a0-a24d-bbb6ba8d41df req-0369d32d-12d7-440f-becd-cf3a81435eee tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319989 Jun 17 11:05:34.940571 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5a17ce-aa0c-4bf5-8e91-b77bb7ca6012 req-1db93cdb-bd34-49ad-b5d8-61d24435709b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:34.941952 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9f5a17ce-aa0c-4bf5-8e91-b77bb7ca6012 req-1db93cdb-bd34-49ad-b5d8-61d24435709b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0632181 Jun 17 11:05:34.953312 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39162) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:34.958134 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-4301e746-921a-499d-bf15-635014a414d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'floatingip': {'port_id': '787f2fec-2d83-44f5-9283-874e16102ce0'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:05:35.029286 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4301e746-921a-499d-bf15-635014a414d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:35.255673 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e60792-0943-4287-bbea-742b7b81971c req-22185f58-58a1-4bad-96d3-91e369391d59 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:35.257810 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-21e60792-0943-4287-bbea-742b7b81971c req-22185f58-58a1-4bad-96d3-91e369391d59 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 946 time: 0.0638049 Jun 17 11:05:35.294763 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-21e60792-0943-4287-bbea-742b7b81971c req-7ef5cf76-f69d-4b2b-bb6a-0fca82eabe6e tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/security-groups?id=fee73bc9-1acf-45ca-8281-284d22c0b22f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306847 Jun 17 11:05:35.502044 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b2290f0-3053-4124-b295-5de13c4274f4 req-1b497ea2-b4c9-4d29-a656-8140e857e123 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:35.503623 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4b2290f0-3053-4124-b295-5de13c4274f4 req-1b497ea2-b4c9-4d29-a656-8140e857e123 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.25 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 946 time: 0.0849664 Jun 17 11:05:35.620162 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-4b2290f0-3053-4124-b295-5de13c4274f4 req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Deleting port 6f120683-9585-46d0-bfd8-a6c28bf5562f {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:05:35.620497 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-4b2290f0-3053-4124-b295-5de13c4274f4 req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:35.722545 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-4b2290f0-3053-4124-b295-5de13c4274f4 req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] For port 6f120683-9585-46d0-bfd8-a6c28bf5562f, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=6f120683-9585-46d0-bfd8-a6c28bf5562f,segment=NetworkSegment(b30833e2-269b-473f-8667-473b40248da0),segment_id=b30833e2-269b-473f-8667-473b40248da0)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:05:35.722926 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-4b2290f0-3053-4124-b295-5de13c4274f4 req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:35.736415 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4301e746-921a-499d-bf15-635014a414d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:35.857342 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4301e746-921a-499d-bf15-635014a414d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:35.964639 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.l3_db [None req-4301e746-921a-499d-bf15-635014a414d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Floating IP 8c6b595c-a5db-41e7-b635-7cbfa17d2243 associated. External IP: 172.27.3.94, port: 787f2fec-2d83-44f5-9283-874e16102ce0. Jun 17 11:05:36.026225 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-4b2290f0-3053-4124-b295-5de13c4274f4 req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Calling delete_port for 6f120683-9585-46d0-bfd8-a6c28bf5562f owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:05:36.175596 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4301e746-921a-499d-bf15-635014a414d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Router a0be9488-bc15-4149-b213-8c5540303580 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:05:36.211721 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-4b2290f0-3053-4124-b295-5de13c4274f4 req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:36.215854 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4582feb3-53c9-41f5-be93-061eb383db18 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:36.224550 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['6f120683-9585-46d0-bfd8-a6c28bf5562f'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:05:36.239196 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Pushing event deleted for resources: {'Port': ['ID=6f120683-9585-46d0-bfd8-a6c28bf5562f,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:36.242646 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:36.288278 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4301e746-921a-499d-bf15-635014a414d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:05:36.293381 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4301e746-921a-499d-bf15-635014a414d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:36.294781 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-4b2290f0-3053-4124-b295-5de13c4274f4 req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] No DVR routers for this DVR port 6f120683-9585-46d0-bfd8-a6c28bf5562f on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:05:36.299758 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dae4db3f-c6c1-4c40-8855-ae1b14278061 None None] Sync routers for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:05:36.305957 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-4b2290f0-3053-4124-b295-5de13c4274f4 req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:36.308155 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4b2290f0-3053-4124-b295-5de13c4274f4 req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.25 "DELETE /v2.0/ports/6f120683-9585-46d0-bfd8-a6c28bf5562f HTTP/1.1" status: 204 len: 173 time: 0.7984791 Jun 17 11:05:36.308746 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dae4db3f-c6c1-4c40-8855-ae1b14278061 None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:05:36.308915 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ebf62d4-7f7c-4434-a11c-4d42d419c7d7', 'name': 'network-vif-deleted', 'tag': '6f120683-9585-46d0-bfd8-a6c28bf5562f'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:05:36.309376 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-dae4db3f-c6c1-4c40-8855-ae1b14278061 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:05:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:36.313372 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-51f8ce2c-3da5-4ad7-acc7-ed30a451ee77" -d '{"events": [{"server_uuid": "4ebf62d4-7f7c-4434-a11c-4d42d419c7d7", "name": "network-vif-deleted", "tag": "6f120683-9585-46d0-bfd8-a6c28bf5562f"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:05:36.333777 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-4301e746-921a-499d-bf15-635014a414d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "PUT /v2.0/floatingips/8c6b595c-a5db-41e7-b635-7cbfa17d2243 HTTP/1.1" status: 200 len: 990 time: 1.3770092 Jun 17 11:05:36.333777 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0'}] {{(pid=110214) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:05:36.337113 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cc2cf72888dbbd14a3b8c118b05d43e907687f619eecab2abc2da29781eba8b9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd389127-bd13-4ab9-9720-f3488b8e0024" -d '{"events": [{"name": "network-changed", "server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0"}]}' {{(pid=110214) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:05:36.363684 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:05:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ab2cc3f1-151f-4b59-bb4f-b2242eb60a53 x-openstack-request-id: req-ab2cc3f1-151f-4b59-bb4f-b2242eb60a53 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:05:36.364284 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ebf62d4-7f7c-4434-a11c-4d42d419c7d7", "name": "network-vif-deleted", "tag": "6f120683-9585-46d0-bfd8-a6c28bf5562f", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:05:36.364620 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-ab2cc3f1-151f-4b59-bb4f-b2242eb60a53 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:05:36.365137 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ebf62d4-7f7c-4434-a11c-4d42d419c7d7', 'name': 'network-vif-deleted', 'tag': '6f120683-9585-46d0-bfd8-a6c28bf5562f', 'status': 'completed', 'code': 200} Jun 17 11:05:36.424420 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-dae4db3f-c6c1-4c40-8855-ae1b14278061 None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:05:36.468368 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6f02aa20-93c2-4a57-934e-6dd406d2feea req-9533852c-32f5-4e31-a11d-dea0be871a52 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ebf62d4-7f7c-4434-a11c-4d42d419c7d7 HTTP/1.1" status: 200 len: 210 time: 0.0337121 Jun 17 11:05:36.525813 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:05:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-981e4902-0f4f-42ca-b798-f0d72e194395 x-openstack-request-id: req-981e4902-0f4f-42ca-b798-f0d72e194395 {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:05:36.526132 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0", "status": "completed", "code": 200}]} {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:05:36.526404 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-981e4902-0f4f-42ca-b798-f0d72e194395 {{(pid=110214) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:05:36.526719 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0', 'status': 'completed', 'code': 200} Jun 17 11:05:36.651602 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd389127-bd13-4ab9-9720-f3488b8e0024 req-9cd35b61-02ab-4594-8cf3-bb4d16bd95f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:36.653123 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd389127-bd13-4ab9-9720-f3488b8e0024 req-9cd35b61-02ab-4594-8cf3-bb4d16bd95f5 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 1098 time: 0.0695662 Jun 17 11:05:36.719544 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-dae4db3f-c6c1-4c40-8855-ae1b14278061 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '8c6b595c-a5db-41e7-b635-7cbfa17d2243', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'floating_ip_address': '172.27.3.94', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'port_id': '787f2fec-2d83-44f5-9283-874e16102ce0', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 532, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'mac_address': 'fa:16:3e:d7:aa:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c49d302-8c28-401f-b355-26568b700ec5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:05:15Z', 'updated_at': '2021-06-17T11:05:35Z', 'revision_number': 1, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:36.749827 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dae4db3f-c6c1-4c40-8855-ae1b14278061 None None] Checking router: a0be9488-bc15-4149-b213-8c5540303580 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:05:36.760364 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dae4db3f-c6c1-4c40-8855-ae1b14278061 None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:05:36.761017 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-dae4db3f-c6c1-4c40-8855-ae1b14278061 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:05:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:36.769878 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd389127-bd13-4ab9-9720-f3488b8e0024 req-6740fd30-8b44-4a2c-88d0-ca71be821031 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:36.771572 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd389127-bd13-4ab9-9720-f3488b8e0024 req-6740fd30-8b44-4a2c-88d0-ca71be821031 service neutron] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 918 time: 0.1059675 Jun 17 11:05:36.840890 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd389127-bd13-4ab9-9720-f3488b8e0024 req-c4e0ec77-accf-49d1-b62e-aa83503268dc service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=787f2fec-2d83-44f5-9283-874e16102ce0 HTTP/1.1" status: 200 len: 998 time: 0.0619721 Jun 17 11:05:36.870336 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-dae4db3f-c6c1-4c40-8855-ae1b14278061 None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:05:36.893813 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd389127-bd13-4ab9-9720-f3488b8e0024 req-fdc37a3e-c0ba-41f8-8a5e-48554a30de66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:36.895828 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd389127-bd13-4ab9-9720-f3488b8e0024 req-fdc37a3e-c0ba-41f8-8a5e-48554a30de66 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0467775 Jun 17 11:05:36.963734 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd389127-bd13-4ab9-9720-f3488b8e0024 req-764fda43-664d-4aff-8e0d-ef7c6e81e6c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:05:36.965367 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd389127-bd13-4ab9-9720-f3488b8e0024 req-764fda43-664d-4aff-8e0d-ef7c6e81e6c6 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0617177 Jun 17 11:05:37.073324 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd389127-bd13-4ab9-9720-f3488b8e0024 req-7d774a48-3e4a-4aeb-8ac0-248b71457b87 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0985363 Jun 17 11:05:37.175253 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd389127-bd13-4ab9-9720-f3488b8e0024 req-6cada3a0-1897-4e64-99b5-07201e039f3c service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0937977 Jun 17 11:05:37.245965 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-dae4db3f-c6c1-4c40-8855-ae1b14278061 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '8c6b595c-a5db-41e7-b635-7cbfa17d2243', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'floating_ip_address': '172.27.3.94', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'port_id': '787f2fec-2d83-44f5-9283-874e16102ce0', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 532, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'mac_address': 'fa:16:3e:d7:aa:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c49d302-8c28-401f-b355-26568b700ec5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:05:15Z', 'updated_at': '2021-06-17T11:05:35Z', 'revision_number': 1, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:05:37.284374 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dae4db3f-c6c1-4c40-8855-ae1b14278061 None None] The sync data for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi is: [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '8c6b595c-a5db-41e7-b635-7cbfa17d2243', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'floating_ip_address': '172.27.3.94', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'port_id': '787f2fec-2d83-44f5-9283-874e16102ce0', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 532, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'mac_address': 'fa:16:3e:d7:aa:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c49d302-8c28-401f-b355-26568b700ec5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:05:15Z', 'updated_at': '2021-06-17T11:05:35Z', 'revision_number': 1, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:05:37.477252 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-358efc54-9ffe-48c1-999c-b49df791e238 None None] New status for floating IP 8c6b595c-a5db-41e7-b635-7cbfa17d2243: ACTIVE {{(pid=110218) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:05:37.634059 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:39.164903 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 6f120683-9585-46d0-bfd8-a6c28bf5562f no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:05:39.186531 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 6f120683-9585-46d0-bfd8-a6c28bf5562f {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:05:39.186913 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 6f120683-9585-46d0-bfd8-a6c28bf5562f not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:05:46.797660 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39324) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:46.907447 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-45adb132-32ec-44fa-a1c5-1b575b1eaad2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:46.993444 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-45adb132-32ec-44fa-a1c5-1b575b1eaad2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:47.108378 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-45adb132-32ec-44fa-a1c5-1b575b1eaad2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:47.111113 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-45c20de2-b469-493b-97b1-6ec1e65d2835 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:47.145056 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45adb132-32ec-44fa-a1c5-1b575b1eaad2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e809c4b2-9553-4cc7-9c6e-fd07cc37892a,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:47.149843 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-45adb132-32ec-44fa-a1c5-1b575b1eaad2 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=2e87bac5ea4847438c6ccca00ccbc492&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3511615 Jun 17 11:05:47.150906 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-45adb132-32ec-44fa-a1c5-1b575b1eaad2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:47.152421 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39328) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:05:47.205033 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fe37cbbc-c525-4685-ba95-f4e25adb968a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:47.226101 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fe37cbbc-c525-4685-ba95-f4e25adb968a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:47.331091 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fe37cbbc-c525-4685-ba95-f4e25adb968a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:47.333660 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-fe37cbbc-c525-4685-ba95-f4e25adb968a admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:47.335413 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-fe37cbbc-c525-4685-ba95-f4e25adb968a admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/e809c4b2-9553-4cc7-9c6e-fd07cc37892a HTTP/1.1" status: 204 len: 168 time: 0.1814673 Jun 17 11:05:47.343875 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d15f7a50-64bb-42d6-9908-80874cda23c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:05:47.343875 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe37cbbc-c525-4685-ba95-f4e25adb968a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e809c4b2-9553-4cc7-9c6e-fd07cc37892a,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:05:47.345964 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fe37cbbc-c525-4685-ba95-f4e25adb968a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:05:50.645501 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f5dd1ed9-4c4e-4ce6-b266-2286fad100b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:53.343032 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-23e5420f-fc76-4043-a552-6691d268c4d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:53.577102 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:54.450215 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:56.788318 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:05:57.050946 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:06:07.516610 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39474) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:07.559856 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_v2 [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Deleting subnet 4f767ce8-3cfb-498b-9928-86e92efe06d9 {{(pid=110214) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:06:07.563740 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:07.596715 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6228443'] for subnet, precommit_delete_associations {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:07.639180 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:07.656960 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:07.770675 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6239301', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5530029'] for subnet, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:07.773105 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-4d60162e-35ed-40b2-ac4a-1e792bafffb1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:07.798809 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4f767ce8-3cfb-498b-9928-86e92efe06d9,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:07.801211 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:07.803028 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] 10.222.0.41 "DELETE /v2.0/subnets/4f767ce8-3cfb-498b-9928-86e92efe06d9 HTTP/1.1" status: 204 len: 168 time: 0.2853808 Jun 17 11:06:07.805794 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39476) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:07.809076 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.809463 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.809834 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.812613 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.812613 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.812613 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.812613 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.812613 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.812613 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.812613 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.812613 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.813294 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:07.816064 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-86ac28e4-63a8-4677-a7ab-f968f3a8dfab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:07.871890 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:07.951137 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:07.961429 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ac073896-1dc1-4a1c-bbb5-f73d05a0f328']}} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:07.971271 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b30833e2-269b-473f-8667-473b40248da0') {'for_net_delete': True} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:07.971559 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b30833e2-269b-473f-8667-473b40248da0') {} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:07.980523 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6032818'] for segment, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:07.993337 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:07.998920 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Releasing vlan 115 on physical network physnet1 to pool {{(pid=110215) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:06:07.999297 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5898799'] for segment, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: Traceback (most recent call last): Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: timer() Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: cb(*args, **kw) Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: return func(*args, **kwargs) Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: self._notify() Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: self.callback(batched_events) Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: event.method(event) Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: return f(self, *a, **k) Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._get(url).json() Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: return self.request(url, 'GET', **kwargs) Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:06:08.000871 dv-cinder-773870-6-iscsi neutron-server[110215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:06:08.115877 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:08.119810 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-31cabffc-413f-40f4-b0bf-decb3c5836c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:08.122376 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:08.124077 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] 10.222.0.41 "DELETE /v2.0/networks/ac073896-1dc1-4a1c-bbb5-f73d05a0f328 HTTP/1.1" status: 204 len: 168 time: 0.3171737 Jun 17 11:06:08.134996 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Pushing event deleted for resources: {'Network': ['ID=ac073896-1dc1-4a1c-bbb5-f73d05a0f328,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:08.142503 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.142894 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.143263 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.143620 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.143985 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.144332 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.144681 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.145028 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.145402 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.145822 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.146175 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.146519 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:08.149705 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:08.570782 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39480) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:08.609483 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-9b228361-5d59-46ab-9a42-ac8e08b170a4 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=639911d94d744c97a47444f2f5785c40&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0372865 Jun 17 11:06:08.611813 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39484) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:08.659786 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-56d4f19e-9a37-4cde-bd0a-7cfa71456495 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:08.680748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-56d4f19e-9a37-4cde-bd0a-7cfa71456495 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:08.794081 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-56d4f19e-9a37-4cde-bd0a-7cfa71456495 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:08.796658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-56d4f19e-9a37-4cde-bd0a-7cfa71456495 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:08.797785 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-56d4f19e-9a37-4cde-bd0a-7cfa71456495 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/fee73bc9-1acf-45ca-8281-284d22c0b22f HTTP/1.1" status: 204 len: 168 time: 0.1850667 Jun 17 11:06:08.798524 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-e63ce721-6ecc-4070-9cbd-b1033f0f04a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:08.806712 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d4f19e-9a37-4cde-bd0a-7cfa71456495 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fee73bc9-1acf-45ca-8281-284d22c0b22f,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:08.809766 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-56d4f19e-9a37-4cde-bd0a-7cfa71456495 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:13.275000 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c97767-1002-4884-bac1-6ce1f8120d5c req-760e5a26-cdf3-4200-96ed-299b062bafc6 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:13.276468 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-96c97767-1002-4884-bac1-6ce1f8120d5c req-760e5a26-cdf3-4200-96ed-299b062bafc6 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0760760 Jun 17 11:06:13.314869 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-96c97767-1002-4884-bac1-6ce1f8120d5c req-1e6ad1b9-ec47-4a87-ba6e-8cd37f2eb1a4 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325022 Jun 17 11:06:14.487438 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbc660d3-83d1-4439-9955-63eb735a36e6 req-5b0e708c-51a2-412e-acda-77ad9e27b522 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:14.488880 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-dbc660d3-83d1-4439-9955-63eb735a36e6 req-5b0e708c-51a2-412e-acda-77ad9e27b522 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0615439 Jun 17 11:06:14.526265 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-dbc660d3-83d1-4439-9955-63eb735a36e6 req-23e8365d-6b54-485a-b195-01030c9414e9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317492 Jun 17 11:06:15.698358 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d735d97c-09c3-417f-bd19-e4a2064192d3 req-44ebc3e4-3979-45ba-bf0e-f8f2c67c1431 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:15.699925 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d735d97c-09c3-417f-bd19-e4a2064192d3 req-44ebc3e4-3979-45ba-bf0e-f8f2c67c1431 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0635161 Jun 17 11:06:15.736684 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d735d97c-09c3-417f-bd19-e4a2064192d3 req-0a4d14cc-aaa6-414f-accb-b4c8aa3776fd tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310984 Jun 17 11:06:16.911019 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18a5f41-f6ee-4c38-a36e-e49f0e05b165 req-bf8ecb87-bd4c-45e6-8630-4b4ff6aae115 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:16.912497 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a18a5f41-f6ee-4c38-a36e-e49f0e05b165 req-bf8ecb87-bd4c-45e6-8630-4b4ff6aae115 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0646362 Jun 17 11:06:16.948814 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a18a5f41-f6ee-4c38-a36e-e49f0e05b165 req-6151c7e5-f29b-4e01-9d4d-80b0e348bf81 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306423 Jun 17 11:06:18.118730 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9117e235-f0a2-4c84-a074-538bf2fe40a5 req-a099556d-59e6-4a04-a5af-5ec6ba93cd41 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:18.120234 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9117e235-f0a2-4c84-a074-538bf2fe40a5 req-a099556d-59e6-4a04-a5af-5ec6ba93cd41 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0623038 Jun 17 11:06:18.158067 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9117e235-f0a2-4c84-a074-538bf2fe40a5 req-b720cd38-7114-450f-ae31-8f2b14d2f124 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0323505 Jun 17 11:06:19.350351 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec8e49a-e8e1-4f57-aa0f-f5a9fd940938 req-76f31a99-cd76-4e73-ba46-096abaac1608 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:19.351831 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-eec8e49a-e8e1-4f57-aa0f-f5a9fd940938 req-76f31a99-cd76-4e73-ba46-096abaac1608 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0779433 Jun 17 11:06:19.389808 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-eec8e49a-e8e1-4f57-aa0f-f5a9fd940938 req-cfd9fb9a-6b59-408f-8946-de993cfff6a7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314353 Jun 17 11:06:20.561281 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132a2bee-af9c-41ec-bda0-c24d11ee65a6 req-a63d112f-a039-42d7-bb6e-ace3ebbc1e14 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:20.562731 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-132a2bee-af9c-41ec-bda0-c24d11ee65a6 req-a63d112f-a039-42d7-bb6e-ace3ebbc1e14 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0619080 Jun 17 11:06:20.601380 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-132a2bee-af9c-41ec-bda0-c24d11ee65a6 req-dcdf2a9f-486d-4760-87a3-1a91a3824d68 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0329049 Jun 17 11:06:20.668391 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-5c1aebcf-64dc-4646-b90c-1e4a1e237b7c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:21.706159 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39612) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:21.773668 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7395a8-4354-4943-be31-f623297570c0 req-c2bcf045-bf04-439e-b254-3e3c185b3ee0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:21.778011 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0f7395a8-4354-4943-be31-f623297570c0 req-c2bcf045-bf04-439e-b254-3e3c185b3ee0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0651147 Jun 17 11:06:21.810079 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3c0f7a44-9f6a-40e7-b174-35d31e5cf406 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:21.813566 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0f7395a8-4354-4943-be31-f623297570c0 req-069d51a1-356f-4bd7-b15b-5be410d66e49 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0328553 Jun 17 11:06:21.898422 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3c0f7a44-9f6a-40e7-b174-35d31e5cf406 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:21.976811 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-3c0f7a44-9f6a-40e7-b174-35d31e5cf406 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:21.979323 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-873abb89-6167-4d83-ad9f-59c83169ce0e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:22.015510 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-3c0f7a44-9f6a-40e7-b174-35d31e5cf406 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=c938c3926f634d4f9ed784f0a4976f28&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3082621 Jun 17 11:06:22.016550 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c0f7a44-9f6a-40e7-b174-35d31e5cf406 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1448e3c6-a99d-411f-8aa2-7b337bac6f5c,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:22.018208 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39616) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:22.019809 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-3c0f7a44-9f6a-40e7-b174-35d31e5cf406 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:22.070569 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-816c8839-e902-43df-9253-559fb703af1a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:22.091193 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-816c8839-e902-43df-9253-559fb703af1a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:22.291638 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-816c8839-e902-43df-9253-559fb703af1a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:22.294726 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-816c8839-e902-43df-9253-559fb703af1a admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:22.295901 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-816c8839-e902-43df-9253-559fb703af1a admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/1448e3c6-a99d-411f-8aa2-7b337bac6f5c HTTP/1.1" status: 204 len: 168 time: 0.2766383 Jun 17 11:06:22.296670 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a7b08e84-0e45-4b3a-a04c-e00c0f145d7a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:22.304437 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816c8839-e902-43df-9253-559fb703af1a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1448e3c6-a99d-411f-8aa2-7b337bac6f5c,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:22.306706 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-816c8839-e902-43df-9253-559fb703af1a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:22.988100 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc53bfa-8f02-4a36-ba0b-6ca0af00d729 req-4d4d0fb3-eaa7-487f-90c6-d0c349f37527 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:22.989561 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6dc53bfa-8f02-4a36-ba0b-6ca0af00d729 req-4d4d0fb3-eaa7-487f-90c6-d0c349f37527 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0628395 Jun 17 11:06:23.027677 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6dc53bfa-8f02-4a36-ba0b-6ca0af00d729 req-bdcc519b-da85-44fc-8e51-0736c76a68d0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0323691 Jun 17 11:06:23.364864 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-4993f67c-4f83-4139-b1e9-df97a216e825 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:23.427181 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39644) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:23.521968 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1135349585-network', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:23.622366 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:23.662297 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Made reservation on behalf of a7706f138ac3465ba5820edf148d8153 for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:06:23.664765 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:23.673946 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:23.762282 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:23.828218 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:23.831233 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-dfad1eb8-6122-4391-8d42-3fdfe0345741 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:23.852522 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] vlan segment allocate from pool success with {'vlan_id': 135, 'physical_network': 'physnet1'} {{(pid=110215) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 11:06:23.861907 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb6567cf-c7e7-4314-ba31-ceb76c207233,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:23.865926 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:23.866960 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:23.869554 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Added segment 4b17136b-e614-458c-90d5-3642ab6ac536 of type vlan for network 79f5bf09-f965-46d9-8615-13aab136e8eb Jun 17 11:06:23.905870 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:23.988191 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:23.989527 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:23.990109 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:23.992219 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:24.047428 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Pushing event updated for resources: {'Network': ['ID=79f5bf09-f965-46d9-8615-13aab136e8eb,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:24.050134 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:24.057685 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network 79f5bf09-f965-46d9-8615-13aab136e8eb details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 11:06:24.096787 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6683803 Jun 17 11:06:24.099810 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39650) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:24.105528 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Request body: {'subnet': {'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1135349585-subnet', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'ip_version': 4}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:24.211335 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Made reservation on behalf of a7706f138ac3465ba5820edf148d8153 for: {'subnet': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:06:24.213696 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5529992'] for subnet, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:24.366085 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf3f103-6176-4ca6-a3bc-16af32e34b63 req-175368cc-d8d8-45bc-aa02-d30e2e06cb50 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:24.367604 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cdf3f103-6176-4ca6-a3bc-16af32e34b63 req-175368cc-d8d8-45bc-aa02-d30e2e06cb50 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0678561 Jun 17 11:06:24.406373 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cdf3f103-6176-4ca6-a3bc-16af32e34b63 req-ce84995e-4eed-48f7-aa02-2c34b396eb08 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325668 Jun 17 11:06:24.467757 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6239242', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5530010'] for subnet, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:24.470141 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2eea5598-499a-4c78-aa8e-49c8ee26487f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:24.508503 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:24.527440 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1df800fd-de2b-4d27-b603-4af981229332,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:24.529729 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:24.538505 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Checking segment: {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110214) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:06:24.538856 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Network hostable DHCP agents. Network: 79f5bf09-f965-46d9-8615-13aab136e8eb, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110214) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 11:06:24.628195 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Network 79f5bf09-f965-46d9-8615-13aab136e8eb is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110214) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 11:06:24.731854 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, 79f5bf09-f965-46d9-8615-13aab136e8eb) {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:06:24.736146 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:24.742614 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:24.743339 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d94e630e-d77a-4c2c-8aeb-1d74d01a3b32 None None] Network 79f5bf09-f965-46d9-8615-13aab136e8eb requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:06:24.817753 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-e6db7d25-5591-4ff6-b61f-276335fb8096 admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.7167594 Jun 17 11:06:24.820310 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39654) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:24.824813 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:24.884633 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5498e9f9-7e24-5c53-b771-9493a76e3e58-79f5bf09-f965-46d9-8615-13aab136e8eb', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332'}]}} from dv-cinder-773870-6-iscsi. {{(pid=110216) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Jun 17 11:06:24.885473 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:24.897364 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8358582', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1816'] for router, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:24.898392 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8357919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8287158', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-8346348', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2019'] for router, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:24.951005 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:25.036603 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.db_base_plugin_common [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Allocated IP 172.20.0.2 (79f5bf09-f965-46d9-8615-13aab136e8eb/1df800fd-de2b-4d27-b603-4af981229332/d757c630-7d66-4580-bba7-39491a2b41f2) {{(pid=110216) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:06:25.145425 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8287140', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8358552', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2037'] for router, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:25.182415 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Notify callbacks [] for port, precommit_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:25.190430 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Transition to ACTIVE for port object d757c630-7d66-4580-bba7-39491a2b41f2 will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:06:25.204523 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Transition to ACTIVE for port object d757c630-7d66-4580-bba7-39491a2b41f2 will not be triggered until provisioned by entity DHCP. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:06:25.308854 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:25.313024 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2a779021-0275-4c0a-81a6-da578148b5b3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:25.350686 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Network 79f5bf09-f965-46d9-8615-13aab136e8eb is already hosted by enough agents. {{(pid=110216) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:06:25.353647 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.base_scheduler [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Resources bound (agent type, host, resource id): {{(pid=110216) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:06:25.357077 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Received port after_create {{(pid=110216) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:06:25.368137 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Pushing event updated for resources: {'Port': ['ID=d757c630-7d66-4580-bba7-39491a2b41f2,revision_number=1']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:25.372248 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:25.419075 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:25.426257 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Attempting to bind port d757c630-7d66-4580-bba7-39491a2b41f2 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:06:25.426636 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Attempting to bind port d757c630-7d66-4580-bba7-39491a2b41f2 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:06:25.427034 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Attempting to bind port d757c630-7d66-4580-bba7-39491a2b41f2 on network 79f5bf09-f965-46d9-8615-13aab136e8eb {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:06:25.433074 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 6, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:06:25.433471 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Checking segment: {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:06:25.433847 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:25.434287 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Bound using segment: {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:06:25.434770 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Bound port: d757c630-7d66-4580-bba7-39491a2b41f2, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:06:25.435180 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:25.437361 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:25.501402 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] For port d757c630-7d66-4580-bba7-39491a2b41f2, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:06:25.504738 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] For port d757c630-7d66-4580-bba7-39491a2b41f2, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=d757c630-7d66-4580-bba7-39491a2b41f2,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:06:25.544968 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Allocated IP 172.27.3.191 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/80ef5e0e-ad92-467c-b96f-d42eb1a349e4) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:06:25.579982 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1881be9b-03a8-4a99-ba57-f731bb012a92 req-99563769-d50a-4962-abc1-7e4a3820fca3 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:25.581465 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1881be9b-03a8-4a99-ba57-f731bb012a92 req-99563769-d50a-4962-abc1-7e4a3820fca3 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0622795 Jun 17 11:06:25.619142 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:25.622344 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:25.626185 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1881be9b-03a8-4a99-ba57-f731bb012a92 req-00528952-8efd-4e82-b8e3-63e023bbd375 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0360920 Jun 17 11:06:25.661882 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:25.697640 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Pushing event updated for resources: {'Port': ['ID=d757c630-7d66-4580-bba7-39491a2b41f2,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:25.702368 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:25.867534 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:25.869641 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9244cbba-9d1d-44b6-917f-a5719113151b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:25.916998 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:06:25.924755 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:06:25.935426 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Pushing event updated for resources: {'Port': ['ID=80ef5e0e-ad92-467c-b96f-d42eb1a349e4,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:25.935426 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:06:25.935772 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:26.169994 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d757c630-7d66-4580-bba7-39491a2b41f2 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:26.284063 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:26.314475 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port d757c630-7d66-4580-bba7-39491a2b41f2 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:06:26.483323 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8358543', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8287186'] for router, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:26.547733 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a620e90d-94da-42ac-9ab1-2f2ebedd3751 None None] Network 79f5bf09-f965-46d9-8615-13aab136e8eb requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:06:26.662527 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-b93a3b8a-1969-44c1-8a01-8d752794fa7a None None] Provisioning for port d757c630-7d66-4580-bba7-39491a2b41f2 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:06:26.670695 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-b93a3b8a-1969-44c1-8a01-8d752794fa7a None None] Provisioning complete for port d757c630-7d66-4580-bba7-39491a2b41f2 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:26.671104 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-b93a3b8a-1969-44c1-8a01-8d752794fa7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:26.826077 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:26.827426 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-b93a3b8a-1969-44c1-8a01-8d752794fa7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:26.838247 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc041bbd-32ba-4c95-b050-4fc90333c536 req-11cf9c1b-6210-450e-aa1d-c71a647dd9fa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:26.842241 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cc041bbd-32ba-4c95-b050-4fc90333c536 req-11cf9c1b-6210-450e-aa1d-c71a647dd9fa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0911903 Jun 17 11:06:26.865360 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-b93a3b8a-1969-44c1-8a01-8d752794fa7a None None] For port d757c630-7d66-4580-bba7-39491a2b41f2, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=d757c630-7d66-4580-bba7-39491a2b41f2,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:26.887200 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cc041bbd-32ba-4c95-b050-4fc90333c536 req-bb6e3d71-9cc5-4350-8834-8ce1883a5ccf tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440433 Jun 17 11:06:26.942608 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-b93a3b8a-1969-44c1-8a01-8d752794fa7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:26.945413 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:26.982434 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 is scheduled to L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 with binding_index 1 {{(pid=110214) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} Jun 17 11:06:26.997086 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b93a3b8a-1969-44c1-8a01-8d752794fa7a None None] Pushing event updated for resources: {'Port': ['ID=d757c630-7d66-4580-bba7-39491a2b41f2,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:27.000551 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-b93a3b8a-1969-44c1-8a01-8d752794fa7a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:27.060205 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-75e8a93b-8091-4a0c-931b-54c30c5494cb None None] Provisioning complete for port d757c630-7d66-4580-bba7-39491a2b41f2 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:27.060923 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-75e8a93b-8091-4a0c-931b-54c30c5494cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:27.086145 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:06:27.098714 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Sync routers for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:06:27.114898 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:27.115529 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:27.177283 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] Notify callbacks [] for router, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:27.180917 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-4b223670-18c0-4c02-96b4-21011ef8763c admin admin] 10.222.0.41 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.3571763 Jun 17 11:06:27.181235 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39664) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:27.244719 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:27.425255 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:26Z', 'revision_number': 3, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:25Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:27.455414 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Checking router: 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:06:27.455682 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Updating router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 binding host dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:06:27.487967 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:27.584381 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:27.736651 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Allocated IP 172.20.0.1 (79f5bf09-f965-46d9-8615-13aab136e8eb/1df800fd-de2b-4d27-b603-4af981229332/8a8a48c5-e1b7-4c6e-84a1-5f693db6e663) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:06:27.740130 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Notify callbacks [] for port, precommit_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:27.750470 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Transition to ACTIVE for port object 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:06:27.834613 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:27.847696 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Transition to ACTIVE for port object 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:06:27.850989 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:27.854831 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:27.907038 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Attempting to bind port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:06:27.907477 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Attempting to bind port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:06:27.907847 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Attempting to bind port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 on network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:06:27.909699 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fba0e838-69c7-4166-8f34-f6655851145c None None] Pushing event updated for resources: {'Port': ['ID=80ef5e0e-ad92-467c-b96f-d42eb1a349e4,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:27.913368 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-fba0e838-69c7-4166-8f34-f6655851145c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:27.917883 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 6, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:06:27.917883 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Checking segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:06:27.917883 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:27.917883 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Bound using segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:06:27.917883 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Bound port: 80ef5e0e-ad92-467c-b96f-d42eb1a349e4, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:06:27.917883 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:27.966368 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:27.970210 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-16b054cb-e287-44c3-89b2-3106193d87ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:27.971478 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] For port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:06:27.974646 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] For port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=80ef5e0e-ad92-467c-b96f-d42eb1a349e4,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:06:28.016705 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Network 79f5bf09-f965-46d9-8615-13aab136e8eb is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:06:28.029904 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:06:28.044880 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:06:28.058222 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:28.062625 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:28.084433 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Pushing event updated for resources: {'Port': ['ID=8a8a48c5-e1b7-4c6e-84a1-5f693db6e663,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:28.089287 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:28.115249 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8290659'] for router_interface, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:28.138629 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:28.139723 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:28.175679 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbb3724-0980-4a54-9417-59cb3ad5271c req-486463ef-43aa-44da-b378-79bb8b3af6eb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:28.177177 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6fbb3724-0980-4a54-9417-59cb3ad5271c req-486463ef-43aa-44da-b378-79bb8b3af6eb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.1595461 Jun 17 11:06:28.212307 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d757c630-7d66-4580-bba7-39491a2b41f2 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:28.255971 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6fbb3724-0980-4a54-9417-59cb3ad5271c req-9304782a-5987-4e16-8b18-2b076d8df060 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0720358 Jun 17 11:06:28.391777 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fba0e838-69c7-4166-8f34-f6655851145c None None] Pushing event updated for resources: {'Port': ['ID=80ef5e0e-ad92-467c-b96f-d42eb1a349e4,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:28.401591 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-fba0e838-69c7-4166-8f34-f6655851145c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.339s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:28.432545 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:28.455971 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:28.497054 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port d757c630-7d66-4580-bba7-39491a2b41f2 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:28.497436 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:28.525903 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-267100f6-0274-4193-a950-b551f704fe86 None None] Provisioning for port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:06:28.568875 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-267100f6-0274-4193-a950-b551f704fe86 None None] Provisioning complete for port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:28.569252 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-267100f6-0274-4193-a950-b551f704fe86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:28.618987 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:28.627049 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-267100f6-0274-4193-a950-b551f704fe86 None None] Port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:06:28.711013 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:26Z', 'revision_number': 3, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:28.731227 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:28.733499 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:28.737558 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4feeb25b-abff-481e-84ed-030e6d66dec8 None None] The sync data for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi is: [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:26Z', 'revision_number': 3, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:06:28.799995 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7899558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8290591'] for router_interface, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:28.801889 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Pushing event updated for resources: {'Port': ['ID=8a8a48c5-e1b7-4c6e-84a1-5f693db6e663,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:28.805549 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:28.897830 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Network 79f5bf09-f965-46d9-8615-13aab136e8eb is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:06:28.899597 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:06:29.039913 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:06:29.251512 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-6f27d67e-d5c3-4899-b3d1-308d59ae0898 None None] Provisioning complete for port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:29.252160 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6f27d67e-d5c3-4899-b3d1-308d59ae0898 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:29.291632 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-6f27d67e-d5c3-4899-b3d1-308d59ae0898 None None] Port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:06:29.444363 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:06:29.450610 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] 10.222.0.41 "PUT /v2.0/routers/1bb918b0-c975-4f28-83d6-0f8096dc1ea8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2683280 Jun 17 11:06:29.474840 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21218d4d-a3cf-49e1-9663-6f1d9d0bd509 req-e972aa62-0881-44f5-9f91-7f0ab6db862a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:29.476187 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-21218d4d-a3cf-49e1-9663-6f1d9d0bd509 req-e972aa62-0881-44f5-9f91-7f0ab6db862a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0969653 Jun 17 11:06:29.517391 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-21218d4d-a3cf-49e1-9663-6f1d9d0bd509 req-d55d1420-984e-4f9c-a085-29066a3688d9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0345047 Jun 17 11:06:30.081440 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd9af56-ccfe-4fcd-8483-d950d27037ae req-873edd59-dd95-46dd-a032-82a4c941c83d tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:30.082941 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1bd9af56-ccfe-4fcd-8483-d950d27037ae req-873edd59-dd95-46dd-a032-82a4c941c83d tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0649917 Jun 17 11:06:30.133728 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1bd9af56-ccfe-4fcd-8483-d950d27037ae req-26c046cc-8b08-431b-994d-bc016ac77e1e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378437 Jun 17 11:06:30.197404 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32214d8b-a5ff-4efe-95cc-15c66ab8cd83 req-e32e2748-310a-418d-86bc-635f2f17d00e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:30.199265 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-32214d8b-a5ff-4efe-95cc-15c66ab8cd83 req-e32e2748-310a-418d-86bc-635f2f17d00e service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 1098 time: 0.0640306 Jun 17 11:06:30.220029 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:30.309944 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32214d8b-a5ff-4efe-95cc-15c66ab8cd83 req-a65e7f4c-d91a-4db5-b5cf-245382f2df71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:30.311442 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-32214d8b-a5ff-4efe-95cc-15c66ab8cd83 req-a65e7f4c-d91a-4db5-b5cf-245382f2df71 service neutron] 10.222.0.25 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 911 time: 0.1027260 Jun 17 11:06:30.330609 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39694) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:30.335727 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1639554808-network', 'tenant_id': '1d11d9badea6421585a99e4199bc739c'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:30.380251 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:06:30.381678 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:30.382058 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.391826 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-32214d8b-a5ff-4efe-95cc-15c66ab8cd83 req-f391c9ad-9ba0-4ba3-ad37-2ae57f9d5925 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=584d5dfc-3f46-4820-80b2-e729ce075654 HTTP/1.1" status: 200 len: 1000 time: 0.0678744 Jun 17 11:06:30.442934 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32214d8b-a5ff-4efe-95cc-15c66ab8cd83 req-a0a22308-57a0-44b6-aa48-73886caec05d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:30.444401 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-32214d8b-a5ff-4efe-95cc-15c66ab8cd83 req-a0a22308-57a0-44b6-aa48-73886caec05d service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 200 len: 849 time: 0.0459497 Jun 17 11:06:30.449051 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Sync routers for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:06:30.459286 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:30.459925 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:30.464304 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.473691 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Made reservation on behalf of 1d11d9badea6421585a99e4199bc739c for: {'network': 1} {{(pid=110214) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:06:30.476074 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.486100 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=80ef5e0e-ad92-467c-b96f-d42eb1a349e4,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:30.491450 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.507060 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32214d8b-a5ff-4efe-95cc-15c66ab8cd83 req-fab85eed-610c-4e8a-9fa0-f7f6bafb0689 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:30.508855 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-32214d8b-a5ff-4efe-95cc-15c66ab8cd83 req-fab85eed-610c-4e8a-9fa0-f7f6bafb0689 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=54973ccd-0b2b-4517-ad28-76a3128a2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0578592 Jun 17 11:06:30.573827 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:30.581395 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.594221 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.596150 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:30.609399 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-32214d8b-a5ff-4efe-95cc-15c66ab8cd83 req-95ba0e3d-d77e-4b34-9723-ca5a024028a3 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929840 Jun 17 11:06:30.643671 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=80ef5e0e-ad92-467c-b96f-d42eb1a349e4,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:30.652556 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.661705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.661705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.661705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.661705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.661705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.661705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.661705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.661705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.661705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.661705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.661705 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:30.663954 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:30.697166 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.702781 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-32214d8b-a5ff-4efe-95cc-15c66ab8cd83 req-3b47d1ae-15bc-4933-b1ae-f48a2d202c9f service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852218 Jun 17 11:06:30.704310 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-171a78ee-d969-423d-94c1-b5c95376535d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:30.711801 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=110214) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 11:06:30.727729 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.728089 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.segments_db [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Added segment 6da795d9-bcc2-4d51-a172-5202131b57f9 of type vlan for network 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df Jun 17 11:06:30.773422 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce301ec3-88ff-4f39-b3e5-e16a5ee1e3db,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:30.777300 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 2, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:30.779085 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:30.780824 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.807424 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Checking router: 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:06:30.807783 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Updating router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 binding host dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:06:30.841814 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.960236 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.961700 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:30.962289 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:30.964521 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-4bf6d010-3263-4882-a645-86535cf7183a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:31.023484 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Pushing event updated for resources: {'Network': ['ID=9d7d2d3e-f720-4915-9cdc-d3fa1cb712df,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:31.026183 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:31.033085 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 11:06:31.091862 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7599578 Jun 17 11:06:31.094527 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39698) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:31.098962 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Notify callbacks [] for port, precommit_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:31.100290 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Request body: {'subnet': {'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1639554808-subnet', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'ip_version': 4}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:31.108531 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.provisioning_blocks [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Transition to ACTIVE for port object 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 will not be triggered until provisioned by entity L2. {{(pid=110218) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:06:31.193912 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:31.196629 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-01a8e5bd-7f82-495b-adad-8e7c6c7153a9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:31.205598 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Made reservation on behalf of 1d11d9badea6421585a99e4199bc739c for: {'subnet': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:06:31.208236 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5636039'] for subnet, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:31.239942 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Pushing event updated for resources: {'Port': ['ID=8a8a48c5-e1b7-4c6e-84a1-5f693db6e663,revision_number=3']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:31.272627 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.273011 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.280743 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.280743 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.280743 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.280743 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.280743 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.280743 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.280743 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.280743 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.280743 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.280743 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110218) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:06:31.284655 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:31.357378 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Attempting to bind port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:06:31.361865 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Attempting to bind port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:06:31.361865 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Attempting to bind port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 on network 79f5bf09-f965-46d9-8615-13aab136e8eb {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:06:31.365308 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 6, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:06:31.366084 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Checking segment: {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110218) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:06:31.366649 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:31.367316 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Bound using segment: {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:06:31.367978 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Bound port: 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'}}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:06:31.368537 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:31.412773 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1acd68f6-4176-4a34-bdf8-910a67ee47b2 req-2080a603-00af-46a3-a3ab-4e0818bcf10c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:31.412773 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1acd68f6-4176-4a34-bdf8-910a67ee47b2 req-2080a603-00af-46a3-a3ab-4e0818bcf10c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.1265202 Jun 17 11:06:31.463459 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] For port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110218) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:06:31.466090 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] For port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=8a8a48c5-e1b7-4c6e-84a1-5f693db6e663,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110218) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:06:31.482223 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1acd68f6-4176-4a34-bdf8-910a67ee47b2 req-ad73418b-b6ea-49c4-aaf5-bee4450ebf41 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0697114 Jun 17 11:06:31.565912 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:31.568219 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:31.600609 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5898957', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5636053'] for subnet, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:31.604172 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:31.621392 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:31.622618 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:31.656912 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Pushing event updated for resources: {'Subnet': ['ID=0d3143a1-382a-4be3-8a4e-ee1df88a5463,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:31.661860 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Pushing event updated for resources: {'Port': ['ID=8a8a48c5-e1b7-4c6e-84a1-5f693db6e663,revision_number=4']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:31.664102 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:31.673944 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Checking segment: {'id': '6da795d9-bcc2-4d51-a172-5202131b57f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:06:31.674302 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Network hostable DHCP agents. Network: 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110215) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 11:06:31.696998 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-a9b33b8c-a6cc-49d3-9834-b2852deded69 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:31.741220 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:31.759692 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Network 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110215) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 11:06:31.828000 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df) {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:06:31.832419 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:31.833017 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:31.838804 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-563a8f54-0c71-45d8-915f-8cdf6c9728a0 None None] Network 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:06:31.929058 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-cb7652ca-7c98-47cb-9f30-cfea94c64e4e admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.8311315 Jun 17 11:06:31.929316 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39704) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:31.933811 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1639554808-router', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:31.943794 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:31Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:31.973689 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e9536e5-5ef7-4cfe-aa15-d4cd6f623a3c None None] The sync data for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi is: [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:31Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:06:31.991108 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp5498e9f9-7e24-5c53-b771-9493a76e3e58-9d7d2d3e-f720-4915-9cdc-d3fa1cb712df', 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'fixed_ips': [{'subnet_id': '0d3143a1-382a-4be3-8a4e-ee1df88a5463'}]}} from dv-cinder-773870-6-iscsi. {{(pid=110216) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Jun 17 11:06:31.992173 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.040457 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-8358582', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1816'] for router, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.042501 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-8357919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-8287158', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-8346348', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2019'] for router, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.109136 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.163815 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.db_base_plugin_common [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Allocated IP 172.20.0.2 (9d7d2d3e-f720-4915-9cdc-d3fa1cb712df/0d3143a1-382a-4be3-8a4e-ee1df88a5463/d642d88d-f459-4c3f-82a1-35a0cdc09cee) {{(pid=110216) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:06:32.264740 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:32.360902 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-8287140', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-8358552', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2037'] for router, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.366998 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Notify callbacks [] for port, precommit_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.375324 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Transition to ACTIVE for port object d642d88d-f459-4c3f-82a1-35a0cdc09cee will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:06:32.391524 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Transition to ACTIVE for port object d642d88d-f459-4c3f-82a1-35a0cdc09cee will not be triggered until provisioned by entity DHCP. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:06:32.434601 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:06:32.439431 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:32.439806 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.480691 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150'] for port, after_create {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.483391 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:32.521749 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Network 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df is already hosted by enough agents. {{(pid=110216) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:06:32.547001 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.scheduler.base_scheduler [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Resources bound (agent type, host, resource id): {{(pid=110216) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:06:32.555434 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Received port after_create {{(pid=110216) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:06:32.567981 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Pushing event updated for resources: {'Port': ['ID=d642d88d-f459-4c3f-82a1-35a0cdc09cee,revision_number=1']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:32.592302 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:32.621066 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.665291 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=8a8a48c5-e1b7-4c6e-84a1-5f693db6e663,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:32.666793 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Attempting to bind port d642d88d-f459-4c3f-82a1-35a0cdc09cee on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:06:32.673562 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Attempting to bind port d642d88d-f459-4c3f-82a1-35a0cdc09cee by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '6da795d9-bcc2-4d51-a172-5202131b57f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:06:32.673562 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Attempting to bind port d642d88d-f459-4c3f-82a1-35a0cdc09cee on network 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:06:32.676524 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 6, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:06:32.676921 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Checking segment: {'id': '6da795d9-bcc2-4d51-a172-5202131b57f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:06:32.677333 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.678373 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Bound using segment: {'id': '6da795d9-bcc2-4d51-a172-5202131b57f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:06:32.678373 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Bound port: d642d88d-f459-4c3f-82a1-35a0cdc09cee, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6da795d9-bcc2-4d51-a172-5202131b57f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:06:32.679638 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.748085 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] For port d642d88d-f459-4c3f-82a1-35a0cdc09cee, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:06:32.751184 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] For port d642d88d-f459-4c3f-82a1-35a0cdc09cee, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=d642d88d-f459-4c3f-82a1-35a0cdc09cee,segment=NetworkSegment(6da795d9-bcc2-4d51-a172-5202131b57f9),segment_id=6da795d9-bcc2-4d51-a172-5202131b57f9)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:06:32.767643 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.767643 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:32.789314 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f10d2f5b-b9e0-4f99-b709-1ba4e00a3632 req-b7719201-f9ca-4478-a2cb-d6cb5bd266d2 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:32.790455 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:32.798033 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f10d2f5b-b9e0-4f99-b709-1ba4e00a3632 req-b7719201-f9ca-4478-a2cb-d6cb5bd266d2 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.1696146 Jun 17 11:06:32.840909 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.860316 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=8a8a48c5-e1b7-4c6e-84a1-5f693db6e663,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:32.864248 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:32.865826 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:32.866206 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.883661 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f10d2f5b-b9e0-4f99-b709-1ba4e00a3632 req-cc4d9b3f-a5e6-496c-b302-bb0a974f939c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0846567 Jun 17 11:06:32.886088 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.889731 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:32.902895 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-fba0e838-69c7-4166-8f34-f6655851145c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:32.977069 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Pushing event updated for resources: {'Port': ['ID=d642d88d-f459-4c3f-82a1-35a0cdc09cee,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:32.982158 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:33.015047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Allocated IP 172.27.3.210 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/e10e5a3c-f4c9-447f-a41d-92fddeec496d) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:06:33.144212 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:33.264639 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:33.267850 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-71e22a9b-caff-46b2-bfce-f708c0666366 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:33.307224 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:06:33.307224 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:06:33.307224 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:06:33.338423 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Pushing event updated for resources: {'Port': ['ID=e10e5a3c-f4c9-447f-a41d-92fddeec496d,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:33.341188 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:33.657940 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:33.867661 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-8358543', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-8287186'] for router, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:33.902882 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1fc32810-fc92-4efe-92af-d66934abab69 None None] Network 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:06:34.047174 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-33471124-3abd-4c59-befa-90973dfbef64 None None] Provisioning for port d642d88d-f459-4c3f-82a1-35a0cdc09cee completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:06:34.050483 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:06:34.073691 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Router 20449287-f8f8-4a50-bd14-05062b12f3f6 is scheduled to L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 with binding_index 1 {{(pid=110215) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} Jun 17 11:06:34.183053 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:06:34.193908 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Sync routers for ids ['20449287-f8f8-4a50-bd14-05062b12f3f6'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:06:34.206829 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Routers {'20449287-f8f8-4a50-bd14-05062b12f3f6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:34.210562 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20449287-f8f8-4a50-bd14-05062b12f3f6'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:34.273088 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Notify callbacks [] for router, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:34.274129 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d642d88d-f459-4c3f-82a1-35a0cdc09cee up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:34.274334 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] 10.222.0.41 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.3441339 Jun 17 11:06:34.286474 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39714) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:34.362139 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Set router 20449287-f8f8-4a50-bd14-05062b12f3f6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:34.480195 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port d642d88d-f459-4c3f-82a1-35a0cdc09cee completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:06:34.490673 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port d642d88d-f459-4c3f-82a1-35a0cdc09cee triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:34.491089 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:34.710760 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:34.738724 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:34.754224 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'name': 'tempest-TestVolumeBootPattern-1639554808-router', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210'}], 'enable_snat': True}, 'gw_port_id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:33Z', 'revision_number': 3, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'gw_port': {'id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:82:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:34.786422 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Checking router: 20449287-f8f8-4a50-bd14-05062b12f3f6 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:06:34.786786 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Updating router 20449287-f8f8-4a50-bd14-05062b12f3f6 port e10e5a3c-f4c9-447f-a41d-92fddeec496d binding host dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:06:34.820162 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port d642d88d-f459-4c3f-82a1-35a0cdc09cee, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=d642d88d-f459-4c3f-82a1-35a0cdc09cee,segment=NetworkSegment(6da795d9-bcc2-4d51-a172-5202131b57f9),segment_id=6da795d9-bcc2-4d51-a172-5202131b57f9)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:34.832662 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:34.876916 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Allocated IP 172.20.0.1 (9d7d2d3e-f720-4915-9cdc-d3fa1cb712df/0d3143a1-382a-4be3-8a4e-ee1df88a5463/3ccaf261-8495-4cce-b1fe-0a21cafe2da6) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:06:34.931083 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:34.931950 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-ad5e11e6-8df7-4579-ae48-b33a72766b69 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0593483 Jun 17 11:06:34.932922 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:34.959193 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-08c5d26a-e4c9-4d81-9e3b-13cc8c1ce712 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:35.013502 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.027803 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.provisioning_blocks [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Transition to ACTIVE for port object 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 will not be triggered until provisioned by entity DHCP. {{(pid=110214) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:06:35.046805 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-323143a3-60e5-428f-ba4e-8a683d150499 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:35.048482 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-323143a3-60e5-428f-ba4e-8a683d150499 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 1098 time: 0.0666168 Jun 17 11:06:35.049647 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=d642d88d-f459-4c3f-82a1-35a0cdc09cee,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:35.058653 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:35.098078 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:35.098463 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.166212 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.170197 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:35.175401 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-b7db3039-16d1-48fe-a414-8bf1fd28596c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:35.177488 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-b7db3039-16d1-48fe-a414-8bf1fd28596c service neutron] 10.222.0.25 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 911 time: 0.0884495 Jun 17 11:06:35.209798 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Network 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:06:35.214139 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:06:35.219818 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:06:35.250141 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Pushing event updated for resources: {'Port': ['ID=3ccaf261-8495-4cce-b1fe-0a21cafe2da6,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:35.254771 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:35.255110 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Notify callbacks [] for port, precommit_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.260275 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-a32b1e63-5003-4fed-8cbe-f8d1b4e20573 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=584d5dfc-3f46-4820-80b2-e729ce075654 HTTP/1.1" status: 200 len: 1000 time: 0.0720568 Jun 17 11:06:35.264720 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-8290659'] for router_interface, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.269247 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Transition to ACTIVE for port object e10e5a3c-f4c9-447f-a41d-92fddeec496d will not be triggered until provisioned by entity L2. {{(pid=110216) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:06:35.312503 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-22dbe2c3-ad0c-4fb0-af34-8e89e76e8194 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:35.314311 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-22dbe2c3-ad0c-4fb0-af34-8e89e76e8194 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 200 len: 849 time: 0.0466151 Jun 17 11:06:35.374806 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-8fa9f098-1908-4387-a986-692eca455557 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:35.376321 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-8fa9f098-1908-4387-a986-692eca455557 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=54973ccd-0b2b-4517-ad28-76a3128a2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0543299 Jun 17 11:06:35.399924 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.404285 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:35.458187 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd317c5e-bf11-4954-b1fa-27e2f685bcc0 None None] Pushing event updated for resources: {'Port': ['ID=e10e5a3c-f4c9-447f-a41d-92fddeec496d,revision_number=2']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:35.472012 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Attempting to bind port e10e5a3c-f4c9-447f-a41d-92fddeec496d on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:06:35.472012 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Attempting to bind port e10e5a3c-f4c9-447f-a41d-92fddeec496d by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:06:35.472012 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Attempting to bind port e10e5a3c-f4c9-447f-a41d-92fddeec496d on network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:06:35.472012 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-cd317c5e-bf11-4954-b1fa-27e2f685bcc0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:35.472012 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 6, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:06:35.472812 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Checking segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110216) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:06:35.472812 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.473180 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Bound using segment: {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'} {{(pid=110216) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:06:35.473636 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.managers [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Bound port: e10e5a3c-f4c9-447f-a41d-92fddeec496d, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '402f72d8-702e-43eb-a72d-76f851a64294', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}}] {{(pid=110216) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:06:35.474011 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.483881 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-eee300f3-04fe-491d-80b9-135dcad8f689 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0961123 Jun 17 11:06:35.528689 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] For port e10e5a3c-f4c9-447f-a41d-92fddeec496d, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110216) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:06:35.531805 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] For port e10e5a3c-f4c9-447f-a41d-92fddeec496d, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=e10e5a3c-f4c9-447f-a41d-92fddeec496d,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:06:35.542412 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.576609 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9cc3d117-8438-472d-b4f7-eef38da00eb8 req-13b18552-33ba-46d2-baad-361e61961242 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854826 Jun 17 11:06:35.634321 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-76e426eb-e5c0-445e-9af7-6cf6fa1ca23e None None] Provisioning for port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:06:35.638519 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-76e426eb-e5c0-445e-9af7-6cf6fa1ca23e None None] Provisioning complete for port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:35.638924 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-76e426eb-e5c0-445e-9af7-6cf6fa1ca23e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.663854 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.667269 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6c3fdef8-1dfe-4276-976c-aa106e0d75d7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:35.701326 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.706262 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-76e426eb-e5c0-445e-9af7-6cf6fa1ca23e None None] Port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:06:35.730466 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Routers {'20449287-f8f8-4a50-bd14-05062b12f3f6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:35.731649 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20449287-f8f8-4a50-bd14-05062b12f3f6'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:35.736272 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd317c5e-bf11-4954-b1fa-27e2f685bcc0 None None] Pushing event updated for resources: {'Port': ['ID=e10e5a3c-f4c9-447f-a41d-92fddeec496d,revision_number=3']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:35.767337 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-cd317c5e-bf11-4954-b1fa-27e2f685bcc0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:35.788289 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.790771 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:35.844725 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] Set router 20449287-f8f8-4a50-bd14-05062b12f3f6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:35.857095 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Pushing event updated for resources: {'Port': ['ID=3ccaf261-8495-4cce-b1fe-0a21cafe2da6,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:35.859885 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:35.861007 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7899558', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-8290591'] for router_interface, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:35.951642 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Network 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:06:35.953126 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:06:36.048333 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'name': 'tempest-TestVolumeBootPattern-1639554808-router', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210'}], 'enable_snat': True}, 'gw_port_id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:35Z', 'revision_number': 4, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'gw_port': {'id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:82:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '3ccaf261-8495-4cce-b1fe-0a21cafe2da6', 'name': '', 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'mac_address': 'fa:16:3e:14:88:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '0d3143a1-382a-4be3-8a4e-ee1df88a5463', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:34Z', 'updated_at': '2021-06-17T11:06:34Z', 'revision_number': 1, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'subnets': [{'id': '0d3143a1-382a-4be3-8a4e-ee1df88a5463', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:36.072780 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Router 20449287-f8f8-4a50-bd14-05062b12f3f6 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:06:36.088739 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1906f149-8d6b-4b13-9459-6634f50d1319 None None] The sync data for ids ['20449287-f8f8-4a50-bd14-05062b12f3f6'] in dv-cinder-773870-6-iscsi is: [{'id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'name': 'tempest-TestVolumeBootPattern-1639554808-router', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210'}], 'enable_snat': True}, 'gw_port_id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:35Z', 'revision_number': 4, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'gw_port': {'id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:82:3a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '3ccaf261-8495-4cce-b1fe-0a21cafe2da6', 'name': '', 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'mac_address': 'fa:16:3e:14:88:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '0d3143a1-382a-4be3-8a4e-ee1df88a5463', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:34Z', 'updated_at': '2021-06-17T11:06:34Z', 'revision_number': 1, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'subnets': [{'id': '0d3143a1-382a-4be3-8a4e-ee1df88a5463', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:06:36.209983 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:06:36.210580 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d642d88d-f459-4c3f-82a1-35a0cdc09cee up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:36.216354 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] 10.222.0.41 "PUT /v2.0/routers/20449287-f8f8-4a50-bd14-05062b12f3f6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9270194 Jun 17 11:06:36.261331 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-0dedba1b-648a-4773-9dad-98f3f8a970a6 None None] Provisioning complete for port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:36.261876 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-0dedba1b-648a-4773-9dad-98f3f8a970a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:36.303467 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-0dedba1b-648a-4773-9dad-98f3f8a970a6 None None] Port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:06:36.304919 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port d642d88d-f459-4c3f-82a1-35a0cdc09cee triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:36.305325 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:36.955118 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39728) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:36.959871 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-80b065f8-293b-459e-b164-996c76da2c43 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1961343052', 'description': 'tempest-secgroup-smoke-1961343052 description', 'project_id': 'a7706f138ac3465ba5820edf148d8153'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:37.085670 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-80b065f8-293b-459e-b164-996c76da2c43 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.183337 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-80b065f8-293b-459e-b164-996c76da2c43 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.267358 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-80b065f8-293b-459e-b164-996c76da2c43 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.270304 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9251f415-f12d-47d5-8c9b-81f798a90cf9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:37.297956 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80b065f8-293b-459e-b164-996c76da2c43 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:37.300798 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-80b065f8-293b-459e-b164-996c76da2c43 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:37.382666 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-80b065f8-293b-459e-b164-996c76da2c43 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.384241 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-80b065f8-293b-459e-b164-996c76da2c43 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.4281187 Jun 17 11:06:37.387639 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39732) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:37.392053 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-0e01b597-0bf0-47c8-865b-47340625fe5a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'security_group_rule': {'security_group_id': '3b3dcbc2-41c2-439d-a885-9ba22ead5a7e', 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:37.491156 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0e01b597-0bf0-47c8-865b-47340625fe5a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.547195 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0e01b597-0bf0-47c8-865b-47340625fe5a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.645452 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0e01b597-0bf0-47c8-865b-47340625fe5a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.647744 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a2b4be7e-8e1f-43f1-82d2-bfd3037e885e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:37.664442 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e01b597-0bf0-47c8-865b-47340625fe5a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7950e9d0-bf6e-42f6-867b-de09a97b890e,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:37.667199 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0e01b597-0bf0-47c8-865b-47340625fe5a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:37.673863 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.730991 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0e01b597-0bf0-47c8-865b-47340625fe5a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.732227 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-0e01b597-0bf0-47c8-865b-47340625fe5a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3436830 Jun 17 11:06:37.734967 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39734) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:37.739525 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-16adebcd-c65b-443c-8d00-67224c7773ab tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'security_group_rule': {'security_group_id': '3b3dcbc2-41c2-439d-a885-9ba22ead5a7e', 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:37.839106 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-16adebcd-c65b-443c-8d00-67224c7773ab tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.894309 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-16adebcd-c65b-443c-8d00-67224c7773ab tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.988085 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-16adebcd-c65b-443c-8d00-67224c7773ab tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:37.990449 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-799e692d-e5e7-4d4b-bd6f-848f8e3e318c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:38.010605 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16adebcd-c65b-443c-8d00-67224c7773ab tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bc34bc6a-3f4a-4440-a5b2-96e5339e2a6b,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:38.014663 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-16adebcd-c65b-443c-8d00-67224c7773ab tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:38.091157 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-16adebcd-c65b-443c-8d00-67224c7773ab tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.093758 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-16adebcd-c65b-443c-8d00-67224c7773ab tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3567212 Jun 17 11:06:38.103591 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39740) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:38.116507 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-4941add1-ce73-425f-a764-4c56639eed72 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'security_group_rule': {'security_group_id': '3b3dcbc2-41c2-439d-a885-9ba22ead5a7e', 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:38.179357 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device e10e5a3c-f4c9-447f-a41d-92fddeec496d up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:38.221634 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4941add1-ce73-425f-a764-4c56639eed72 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.254434 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39742) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:38.279411 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4941add1-ce73-425f-a764-4c56639eed72 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.302293 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port e10e5a3c-f4c9-447f-a41d-92fddeec496d completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:06:38.306640 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port e10e5a3c-f4c9-447f-a41d-92fddeec496d triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:38.307117 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.371888 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4941add1-ce73-425f-a764-4c56639eed72 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.374135 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:38.395332 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.406721 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4941add1-ce73-425f-a764-4c56639eed72 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c49f24b9-79ed-464d-af10-83427e1360e7,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:38.409516 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-4941add1-ce73-425f-a764-4c56639eed72 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:38.425423 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port e10e5a3c-f4c9-447f-a41d-92fddeec496d, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=e10e5a3c-f4c9-447f-a41d-92fddeec496d,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:38.426104 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Deleting port 464b26bf-d470-4de2-8c8d-afb7a40dae26 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:06:38.426447 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.500296 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.500619 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.520083 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-4941add1-ce73-425f-a764-4c56639eed72 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.521407 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-4941add1-ce73-425f-a764-4c56639eed72 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4118159 Jun 17 11:06:38.524025 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39746) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:38.529447 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-741c346c-6fdc-42ac-bc62-d5eef78113da tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'security_group_rule': {'security_group_id': '3b3dcbc2-41c2-439d-a885-9ba22ead5a7e', 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:38.542471 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.545135 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-59afa2cf-0de9-4e16-af66-483479d460b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:38.569799 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Calling delete_port for 464b26bf-d470-4de2-8c8d-afb7a40dae26 owned by network:floatingip {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:06:38.595983 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=e10e5a3c-f4c9-447f-a41d-92fddeec496d,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:38.599004 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:38.644805 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-741c346c-6fdc-42ac-bc62-d5eef78113da tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.710697 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-741c346c-6fdc-42ac-bc62-d5eef78113da tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.799961 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-741c346c-6fdc-42ac-bc62-d5eef78113da tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.805403 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:38.820600 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-741c346c-6fdc-42ac-bc62-d5eef78113da tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=82b2a333-d5c2-4ddc-806a-101969db8200,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:38.823233 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-741c346c-6fdc-42ac-bc62-d5eef78113da tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:38.879608 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-741c346c-6fdc-42ac-bc62-d5eef78113da tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:38.880956 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-741c346c-6fdc-42ac-bc62-d5eef78113da tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3555562 Jun 17 11:06:38.883980 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39748) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:38.889356 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-9bbcd34d-c5dc-46d2-a22c-046330806bd7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'security_group_rule': {'security_group_id': '3b3dcbc2-41c2-439d-a885-9ba22ead5a7e', 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:38.960501 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.securitygroups_db [None req-9bbcd34d-c5dc-46d2-a22c-046330806bd7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Project a7706f138ac3465ba5820edf148d8153 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jun 17 11:06:38.966559 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9bbcd34d-c5dc-46d2-a22c-046330806bd7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.026904 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9bbcd34d-c5dc-46d2-a22c-046330806bd7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.056018 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.058176 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:39.082928 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event deleted for resources: {'Port': ['ID=464b26bf-d470-4de2-8c8d-afb7a40dae26,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:39.086721 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:39.118734 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9bbcd34d-c5dc-46d2-a22c-046330806bd7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.120933 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:39.143887 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bbcd34d-c5dc-46d2-a22c-046330806bd7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d61dd506-7a2d-4350-9451-8845dd64c50a,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:39.151086 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9bbcd34d-c5dc-46d2-a22c-046330806bd7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:39.151238 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for floatingip, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.151238 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.l3_db [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Floating IP 5b1a7bf4-e4c8-4ee0-8e31-61f24c4aa224 disassociated (deleted). External IP: 172.27.3.162, port: 3084d465-862a-4dca-ba25-6a98d0b14fbb. Jun 17 11:06:39.216927 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9bbcd34d-c5dc-46d2-a22c-046330806bd7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.218198 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-9bbcd34d-c5dc-46d2-a22c-046330806bd7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3331394 Jun 17 11:06:39.221167 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39750) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:39.225816 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-8b4d758d-43b1-4884-a63b-c38f6412ab46 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'security_group_rule': {'security_group_id': '3b3dcbc2-41c2-439d-a885-9ba22ead5a7e', 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:06:39.337254 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.securitygroups_db [None req-8b4d758d-43b1-4884-a63b-c38f6412ab46 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Project a7706f138ac3465ba5820edf148d8153 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Jun 17 11:06:39.348318 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8b4d758d-43b1-4884-a63b-c38f6412ab46 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.357634 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:06:39.418009 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8b4d758d-43b1-4884-a63b-c38f6412ab46 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.468761 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Sync routers for ids ['20449287-f8f8-4a50-bd14-05062b12f3f6'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:06:39.474417 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:06:39.479226 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.481321 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Routers {'20449287-f8f8-4a50-bd14-05062b12f3f6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:39.484520 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5487d29-c0d6-4dcb-b6e6-614d56cb376c None None] Sync routers for ids ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:06:39.487938 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20449287-f8f8-4a50-bd14-05062b12f3f6'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:39.492783 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8b4d758d-43b1-4884-a63b-c38f6412ab46 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.493800 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:39.506007 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5487d29-c0d6-4dcb-b6e6-614d56cb376c None None] Routers {'08615a68-3696-4e03-8e4f-ea190d5c9ca6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:39.508154 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-f5487d29-c0d6-4dcb-b6e6-614d56cb376c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:39.518429 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b4d758d-43b1-4884-a63b-c38f6412ab46 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba1d4e69-c7b3-4b7b-b078-df5916adc7fb,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:39.525129 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "DELETE /v2.0/floatingips/5b1a7bf4-e4c8-4ee0-8e31-61f24c4aa224 HTTP/1.1" status: 204 len: 168 time: 1.2695467 Jun 17 11:06:39.525827 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'tag': '3084d465-862a-4dca-ba25-6a98d0b14fbb'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:06:39.528946 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-351e290e-6a9d-469d-81b2-414e60bad0c4" -d '{"events": [{"name": "network-changed", "server_uuid": "2bdbe412-bb25-418e-87ac-7edfc51cf3af", "tag": "3084d465-862a-4dca-ba25-6a98d0b14fbb"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:06:39.548746 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-8b4d758d-43b1-4884-a63b-c38f6412ab46 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:39.614343 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8b4d758d-43b1-4884-a63b-c38f6412ab46 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.614471 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Set router 20449287-f8f8-4a50-bd14-05062b12f3f6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:39.614589 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-8b4d758d-43b1-4884-a63b-c38f6412ab46 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3906162 Jun 17 11:06:39.680698 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-f5487d29-c0d6-4dcb-b6e6-614d56cb376c None None] Set router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:39.707864 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:06:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ace8a2b9-d769-48f3-bca5-bf6e46bb2f51 x-openstack-request-id: req-ace8a2b9-d769-48f3-bca5-bf6e46bb2f51 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:06:39.708193 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2bdbe412-bb25-418e-87ac-7edfc51cf3af", "tag": "3084d465-862a-4dca-ba25-6a98d0b14fbb", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:06:39.708481 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-ace8a2b9-d769-48f3-bca5-bf6e46bb2f51 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:06:39.708912 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'tag': '3084d465-862a-4dca-ba25-6a98d0b14fbb', 'status': 'completed', 'code': 200} Jun 17 11:06:39.787961 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-351e290e-6a9d-469d-81b2-414e60bad0c4 req-213ecd48-4cb4-49fc-bdc9-41e64af8e5a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:39.789724 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-351e290e-6a9d-469d-81b2-414e60bad0c4 req-213ecd48-4cb4-49fc-bdc9-41e64af8e5a5 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=6c4c0226eef34f24a2c7072aba63129d&device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 1098 time: 0.0563869 Jun 17 11:06:39.852006 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'name': 'tempest-TestVolumeBootPattern-1639554808-router', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210'}], 'enable_snat': True}, 'gw_port_id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:35Z', 'revision_number': 4, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'gw_port': {'id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:82:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '3ccaf261-8495-4cce-b1fe-0a21cafe2da6', 'name': '', 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'mac_address': 'fa:16:3e:14:88:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '0d3143a1-382a-4be3-8a4e-ee1df88a5463', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:34Z', 'updated_at': '2021-06-17T11:06:35Z', 'revision_number': 2, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'subnets': [{'id': '0d3143a1-382a-4be3-8a4e-ee1df88a5463', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:39.891777 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Checking router: 20449287-f8f8-4a50-bd14-05062b12f3f6 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:06:39.892134 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Updating router 20449287-f8f8-4a50-bd14-05062b12f3f6 port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 binding host dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Jun 17 11:06:39.893630 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-351e290e-6a9d-469d-81b2-414e60bad0c4 req-680fd250-5627-4931-9b94-2664ef6a7e17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:39.898754 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-351e290e-6a9d-469d-81b2-414e60bad0c4 req-680fd250-5627-4931-9b94-2664ef6a7e17 service neutron] 10.222.0.25 "GET /v2.0/networks?id=16bcab5c-7033-4cca-98e1-b173b2d78c2f HTTP/1.1" status: 200 len: 908 time: 0.0986452 Jun 17 11:06:39.932753 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:39.947354 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-351e290e-6a9d-469d-81b2-414e60bad0c4 req-c354e0ec-49ec-4a10-b8fa-1c58ebaec37e service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=3084d465-862a-4dca-ba25-6a98d0b14fbb HTTP/1.1" status: 200 len: 217 time: 0.0440080 Jun 17 11:06:39.969980 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-f5487d29-c0d6-4dcb-b6e6-614d56cb376c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:07Z', 'revision_number': 4, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'ae16d63a-186a-4b08-82b7-cde98ae2f1d5', 'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'mac_address': 'fa:16:3e:f6:74:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_interface', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:05Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 5, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'subnets': [{'id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:39.997646 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5487d29-c0d6-4dcb-b6e6-614d56cb376c None None] Checking router: 08615a68-3696-4e03-8e4f-ea190d5c9ca6 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:06:40.007787 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5487d29-c0d6-4dcb-b6e6-614d56cb376c None None] Routers {'08615a68-3696-4e03-8e4f-ea190d5c9ca6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:40.008685 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-f5487d29-c0d6-4dcb-b6e6-614d56cb376c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:40.011149 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-351e290e-6a9d-469d-81b2-414e60bad0c4 req-22d067f2-ef3e-45cb-bd56-4b0f68655387 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:40.012854 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-351e290e-6a9d-469d-81b2-414e60bad0c4 req-22d067f2-ef3e-45cb-bd56-4b0f68655387 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2567fd48-9bd6-4ffa-9d4c-72f989266554 HTTP/1.1" status: 200 len: 846 time: 0.0586810 Jun 17 11:06:40.080020 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-351e290e-6a9d-469d-81b2-414e60bad0c4 req-6c4c53c9-898b-494e-a625-ae4a9f3151e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:40.081726 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-351e290e-6a9d-469d-81b2-414e60bad0c4 req-6c4c53c9-898b-494e-a625-ae4a9f3151e1 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=16bcab5c-7033-4cca-98e1-b173b2d78c2f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0605757 Jun 17 11:06:40.153771 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-f5487d29-c0d6-4dcb-b6e6-614d56cb376c None None] Set router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:40.255234 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-351e290e-6a9d-469d-81b2-414e60bad0c4 req-93a71faa-92e3-4ea4-a9f5-ec1f04ce2e62 service neutron] 10.222.0.25 "GET /v2.0/networks/16bcab5c-7033-4cca-98e1-b173b2d78c2f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1652713 Jun 17 11:06:40.300738 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Notify callbacks [] for port, precommit_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:40.311962 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.provisioning_blocks [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Transition to ACTIVE for port object 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 will not be triggered until provisioned by entity L2. {{(pid=110218) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:06:40.338778 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device e10e5a3c-f4c9-447f-a41d-92fddeec496d up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:40.382913 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:40.386752 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-67420d85-47ce-41f4-a1d0-337a6dffd25e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:40.399928 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfae7a23-7d54-480a-ae4a-33ef34a42c63 req-1345d8e1-8ef8-4961-91d5-3ed8ec1279c6 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:40.401564 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cfae7a23-7d54-480a-ae4a-33ef34a42c63 req-1345d8e1-8ef8-4961-91d5-3ed8ec1279c6 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 945 time: 0.1453347 Jun 17 11:06:40.407910 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-351e290e-6a9d-469d-81b2-414e60bad0c4 req-3f8d3f16-7425-46df-9ca0-8263bdbc6698 service neutron] 10.222.0.25 "GET /v2.0/networks/16bcab5c-7033-4cca-98e1-b173b2d78c2f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1397161 Jun 17 11:06:40.450079 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cfae7a23-7d54-480a-ae4a-33ef34a42c63 req-12409783-4374-4636-9a90-5d84785dfed3 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392673 Jun 17 11:06:40.477608 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca970aa-52d7-44a5-9c91-f49276f99a3e None None] Pushing event updated for resources: {'Port': ['ID=3ccaf261-8495-4cce-b1fe-0a21cafe2da6,revision_number=3']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:40.485811 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-aca970aa-52d7-44a5-9c91-f49276f99a3e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:40.488282 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port e10e5a3c-f4c9-447f-a41d-92fddeec496d triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:40.488776 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:40.576148 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Attempting to bind port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 on host dv-cinder-773870-6-iscsi for vnic_type normal with profile {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:06:40.576525 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Attempting to bind port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 by drivers openvswitch,hyperv on host dv-cinder-773870-6-iscsi at level 0 using segments [{'id': '6da795d9-bcc2-4d51-a172-5202131b57f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df'}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:06:40.576898 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Attempting to bind port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 on network 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:06:40.590271 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Checking agent: {'id': '3033017d-8b2a-43ac-9388-9071a0a604e7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773870-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 51, 23), 'started_at': datetime.datetime(2021, 6, 17, 10, 51, 53), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 6, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773870-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:06:40.595089 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Checking segment: {'id': '6da795d9-bcc2-4d51-a172-5202131b57f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110218) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:06:40.595089 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:40.595089 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Bound using segment: {'id': '6da795d9-bcc2-4d51-a172-5202131b57f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df'} {{(pid=110218) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:06:40.595089 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.managers [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Bound port: 3ccaf261-8495-4cce-b1fe-0a21cafe2da6, host: dv-cinder-773870-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6da795d9-bcc2-4d51-a172-5202131b57f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df'}}] {{(pid=110218) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:06:40.595089 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:40.663761 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-f5487d29-c0d6-4dcb-b6e6-614d56cb376c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:07Z', 'revision_number': 4, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'ae16d63a-186a-4b08-82b7-cde98ae2f1d5', 'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'mac_address': 'fa:16:3e:f6:74:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_interface', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:05Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 5, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'subnets': [{'id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:40.700563 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5487d29-c0d6-4dcb-b6e6-614d56cb376c None None] The sync data for ids ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'] in dv-cinder-773870-6-iscsi is: [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:01:07Z', 'revision_number': 4, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'ae16d63a-186a-4b08-82b7-cde98ae2f1d5', 'name': '', 'network_id': '16bcab5c-7033-4cca-98e1-b173b2d78c2f', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'mac_address': 'fa:16:3e:f6:74:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_interface', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:05Z', 'updated_at': '2021-06-17T11:01:12Z', 'revision_number': 5, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'subnets': [{'id': '2567fd48-9bd6-4ffa-9d4c-72f989266554', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:06:40.711068 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] For port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6, host dv-cinder-773870-6-iscsi, cleared binding levels {{(pid=110218) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:06:40.715185 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.plugins.ml2.db [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] For port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6, host dv-cinder-773870-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=3ccaf261-8495-4cce-b1fe-0a21cafe2da6,segment=NetworkSegment(6da795d9-bcc2-4d51-a172-5202131b57f9),segment_id=6da795d9-bcc2-4d51-a172-5202131b57f9)] {{(pid=110218) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:06:40.794222 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron_lib.callbacks.manager [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110218) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:40.796617 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:40.859404 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Routers {'20449287-f8f8-4a50-bd14-05062b12f3f6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:40.860403 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20449287-f8f8-4a50-bd14-05062b12f3f6'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:40.862652 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca970aa-52d7-44a5-9c91-f49276f99a3e None None] Pushing event updated for resources: {'Port': ['ID=3ccaf261-8495-4cce-b1fe-0a21cafe2da6,revision_number=4']} {{(pid=110218) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:40.866968 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG oslo_concurrency.lockutils [None req-aca970aa-52d7-44a5-9c91-f49276f99a3e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=110218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:40.958147 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99bb031b-a509-4ed9-b007-b35bfee1f746 None None] New status for floating IP 5b1a7bf4-e4c8-4ee0-8e31-61f24c4aa224: DOWN {{(pid=110218) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:06:41.035593 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] Set router 20449287-f8f8-4a50-bd14-05062b12f3f6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:41.250039 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'name': 'tempest-TestVolumeBootPattern-1639554808-router', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210'}], 'enable_snat': True}, 'gw_port_id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:35Z', 'revision_number': 4, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'gw_port': {'id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:82:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '3ccaf261-8495-4cce-b1fe-0a21cafe2da6', 'name': '', 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'mac_address': 'fa:16:3e:14:88:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '0d3143a1-382a-4be3-8a4e-ee1df88a5463', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:34Z', 'updated_at': '2021-06-17T11:06:40Z', 'revision_number': 4, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'subnets': [{'id': '0d3143a1-382a-4be3-8a4e-ee1df88a5463', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:41.286593 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1aaf1463-29bd-4552-af98-9043efc9bb86 None None] The sync data for ids ['20449287-f8f8-4a50-bd14-05062b12f3f6'] in dv-cinder-773870-6-iscsi is: [{'id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'name': 'tempest-TestVolumeBootPattern-1639554808-router', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210'}], 'enable_snat': True}, 'gw_port_id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:35Z', 'revision_number': 4, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'gw_port': {'id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:82:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '3ccaf261-8495-4cce-b1fe-0a21cafe2da6', 'name': '', 'network_id': '9d7d2d3e-f720-4915-9cdc-d3fa1cb712df', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'mac_address': 'fa:16:3e:14:88:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '0d3143a1-382a-4be3-8a4e-ee1df88a5463', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:34Z', 'updated_at': '2021-06-17T11:06:40Z', 'revision_number': 4, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'subnets': [{'id': '0d3143a1-382a-4be3-8a4e-ee1df88a5463', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:06:41.657541 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768ce3ec-b937-4b42-8edc-285d69b2e153 req-d4b70abc-9bdf-4c0f-9e0a-968b1f028c86 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:41.659109 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-768ce3ec-b937-4b42-8edc-285d69b2e153 req-d4b70abc-9bdf-4c0f-9e0a-968b1f028c86 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 945 time: 0.0841155 Jun 17 11:06:41.697055 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-768ce3ec-b937-4b42-8edc-285d69b2e153 req-b1a31283-ad80-4e0a-88dc-06860cf18c56 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/security-groups?id=bccb0152-196e-4e75-b2d0-57c36443b0bc&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321593 Jun 17 11:06:42.176151 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:42.290809 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning for port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:06:42.295265 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:42.295643 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:42.342402 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0f87aad-6e9e-4eb1-9968-ddcdde9f7d50 req-8f4be3fc-d4ad-4889-b1ab-aee9a9fe468d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:42.343884 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b0f87aad-6e9e-4eb1-9968-ddcdde9f7d50 req-8f4be3fc-d4ad-4889-b1ab-aee9a9fe468d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.25 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 945 time: 0.0659983 Jun 17 11:06:42.377853 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:42.412861 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] For port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=3ccaf261-8495-4cce-b1fe-0a21cafe2da6,segment=NetworkSegment(6da795d9-bcc2-4d51-a172-5202131b57f9),segment_id=6da795d9-bcc2-4d51-a172-5202131b57f9)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:42.452379 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-b0f87aad-6e9e-4eb1-9968-ddcdde9f7d50 req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Deleting port 3084d465-862a-4dca-ba25-6a98d0b14fbb {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:06:42.452859 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b0f87aad-6e9e-4eb1-9968-ddcdde9f7d50 req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:42.485580 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:42.487494 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:42.537552 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Pushing event updated for resources: {'Port': ['ID=3ccaf261-8495-4cce-b1fe-0a21cafe2da6,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:42.540605 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:42.553736 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-b0f87aad-6e9e-4eb1-9968-ddcdde9f7d50 req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] For port 3084d465-862a-4dca-ba25-6a98d0b14fbb, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=3084d465-862a-4dca-ba25-6a98d0b14fbb,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:42.554360 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b0f87aad-6e9e-4eb1-9968-ddcdde9f7d50 req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:42.617089 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-b0f87aad-6e9e-4eb1-9968-ddcdde9f7d50 req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Calling delete_port for 3084d465-862a-4dca-ba25-6a98d0b14fbb owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:06:42.820552 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b0f87aad-6e9e-4eb1-9968-ddcdde9f7d50 req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:42.841413 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-796e4f51-561a-460b-93f1-7db763b31a99 tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:42.847688 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-db049122-c2cd-4091-9dae-5ada6314dedb req-9c41d657-ce04-4c23-8958-bea4582ae2af tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 210 time: 0.0377309 Jun 17 11:06:42.866364 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event deleted for resources: {'Port': ['ID=3084d465-862a-4dca-ba25-6a98d0b14fbb,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:42.870144 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:42.932776 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0f87aad-6e9e-4eb1-9968-ddcdde9f7d50 req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] No DVR routers for this DVR port 3084d465-862a-4dca-ba25-6a98d0b14fbb on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:06:42.936605 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b0f87aad-6e9e-4eb1-9968-ddcdde9f7d50 req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:42.939510 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b0f87aad-6e9e-4eb1-9968-ddcdde9f7d50 req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.25 "DELETE /v2.0/ports/3084d465-862a-4dca-ba25-6a98d0b14fbb HTTP/1.1" status: 204 len: 173 time: 0.5891492 Jun 17 11:06:42.940283 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'name': 'network-vif-deleted', 'tag': '3084d465-862a-4dca-ba25-6a98d0b14fbb'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:06:42.943913 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-071c55ae-bc2d-47b8-be19-7e20398262b1" -d '{"events": [{"server_uuid": "2bdbe412-bb25-418e-87ac-7edfc51cf3af", "name": "network-vif-deleted", "tag": "3084d465-862a-4dca-ba25-6a98d0b14fbb"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:06:42.985711 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:06:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9551d8b7-6000-401f-a9a3-9ae192655149 x-openstack-request-id: req-9551d8b7-6000-401f-a9a3-9ae192655149 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:06:42.986137 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2bdbe412-bb25-418e-87ac-7edfc51cf3af", "name": "network-vif-deleted", "tag": "3084d465-862a-4dca-ba25-6a98d0b14fbb", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:06:42.986519 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-9551d8b7-6000-401f-a9a3-9ae192655149 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:06:42.987101 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2bdbe412-bb25-418e-87ac-7edfc51cf3af', 'name': 'network-vif-deleted', 'tag': '3084d465-862a-4dca-ba25-6a98d0b14fbb', 'status': 'completed', 'code': 200} Jun 17 11:06:43.995843 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-57fb302a-8472-4ad9-87cd-664a91a05d35 req-65916832-0c2b-4271-a552-fe4b825ebcef tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "GET /v2.0/ports?device_id=2bdbe412-bb25-418e-87ac-7edfc51cf3af HTTP/1.1" status: 200 len: 210 time: 0.0286732 Jun 17 11:06:44.165439 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 up at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:06:44.212838 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Provisioning complete for port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:06:44.213220 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:44.728995 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ff489c3-596d-4af6-97a9-4d0db2c71ed9 req-2dd70edb-7e6a-4d3f-a14a-45a9fdef06f0 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:44.730469 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0ff489c3-596d-4af6-97a9-4d0db2c71ed9 req-2dd70edb-7e6a-4d3f-a14a-45a9fdef06f0 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0722313 Jun 17 11:06:44.766688 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbda9c50-2c57-486b-a751-f208dd68e98a req-5cdd26af-0141-4444-aaa3-ddc79c9839b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:44.766688 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cbda9c50-2c57-486b-a751-f208dd68e98a req-5cdd26af-0141-4444-aaa3-ddc79c9839b5 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ed69cf6aa40941c48c25effb0c1af8fc&device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 1138 time: 0.0591097 Jun 17 11:06:44.775294 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0ff489c3-596d-4af6-97a9-4d0db2c71ed9 req-d2b41515-878a-44bf-a4b1-d97cb58f2035 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0385621 Jun 17 11:06:44.871627 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbda9c50-2c57-486b-a751-f208dd68e98a req-65f230a6-3cbe-43ca-99a9-687364e10b7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:44.874036 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cbda9c50-2c57-486b-a751-f208dd68e98a req-65f230a6-3cbe-43ca-99a9-687364e10b7f service neutron] 10.222.0.25 "GET /v2.0/networks?id=aeced3ed-7670-4043-a385-87de6f75150b HTTP/1.1" status: 200 len: 916 time: 0.0986974 Jun 17 11:06:44.939789 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cbda9c50-2c57-486b-a751-f208dd68e98a req-e6b0d0aa-cbe4-468c-8e13-744afc240c0e service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 HTTP/1.1" status: 200 len: 1001 time: 0.0579860 Jun 17 11:06:45.004369 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbda9c50-2c57-486b-a751-f208dd68e98a req-252c557d-433c-4006-8e25-be3ed89eeb26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:45.005837 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cbda9c50-2c57-486b-a751-f208dd68e98a req-252c557d-433c-4006-8e25-be3ed89eeb26 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=5d332463-1c62-46e2-a7e3-4b587a2e5f1e HTTP/1.1" status: 200 len: 854 time: 0.0481656 Jun 17 11:06:45.067602 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbda9c50-2c57-486b-a751-f208dd68e98a req-0274b99b-96b2-4b75-974c-ca8a56c62ead service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:45.069383 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cbda9c50-2c57-486b-a751-f208dd68e98a req-0274b99b-96b2-4b75-974c-ca8a56c62ead service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=aeced3ed-7670-4043-a385-87de6f75150b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0557468 Jun 17 11:06:45.101580 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39854) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:45.158675 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c681f52f-074e-4fb8-9caf-337132fbb179 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:45.164733 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cbda9c50-2c57-486b-a751-f208dd68e98a req-eec8cb51-8a37-4c39-a376-7581cf4c42df service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838182 Jun 17 11:06:45.188106 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c681f52f-074e-4fb8-9caf-337132fbb179 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:45.262158 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cbda9c50-2c57-486b-a751-f208dd68e98a req-6531da2e-b1aa-4814-924a-a7133a241839 service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0905101 Jun 17 11:06:45.376621 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c681f52f-074e-4fb8-9caf-337132fbb179 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:45.379331 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-c681f52f-074e-4fb8-9caf-337132fbb179 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:45.380467 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-c681f52f-074e-4fb8-9caf-337132fbb179 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] 10.222.0.41 "DELETE /v2.0/security-groups/bccb0152-196e-4e75-b2d0-57c36443b0bc HTTP/1.1" status: 204 len: 168 time: 0.2825787 Jun 17 11:06:45.381235 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6bf22c43-757e-4329-8cea-e35f8694e00d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:45.393926 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c681f52f-074e-4fb8-9caf-337132fbb179 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bccb0152-196e-4e75-b2d0-57c36443b0bc,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:45.397439 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-c681f52f-074e-4fb8-9caf-337132fbb179 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:45.537365 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39860) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:45.965261 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d534a96-5d8b-43c8-ae4f-b453305843b5 req-e69327cb-6e0c-4387-bd65-9ec701bc6b4e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:45.966875 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4d534a96-5d8b-43c8-ae4f-b453305843b5 req-e69327cb-6e0c-4387-bd65-9ec701bc6b4e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0653284 Jun 17 11:06:46.005718 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4d534a96-5d8b-43c8-ae4f-b453305843b5 req-cbf1f6a1-8817-4c0f-b980-6a6f0e6ad7ab tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0328145 Jun 17 11:06:46.092395 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8355326'] for router_interface, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:46.638244 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Deleting port ae16d63a-186a-4b08-82b7-cde98ae2f1d5 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:06:46.638576 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:46.717285 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] For port ae16d63a-186a-4b08-82b7-cde98ae2f1d5, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=ae16d63a-186a-4b08-82b7-cde98ae2f1d5,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:46.717673 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:46.794866 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Calling delete_port for ae16d63a-186a-4b08-82b7-cde98ae2f1d5 owned by network:router_interface {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:06:47.085953 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:47.088139 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-060ec7a0-c4a7-4d4b-a41b-4ada2380c852 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:47.112489 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Pushing event deleted for resources: {'Port': ['ID=ae16d63a-186a-4b08-82b7-cde98ae2f1d5,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:47.116933 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:47.208864 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7560b0d5-0a27-4f4e-927e-fb75367f2a47 req-0ccf7faf-6395-4f7c-8851-4eee4b1efbb8 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:47.210590 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7560b0d5-0a27-4f4e-927e-fb75367f2a47 req-0ccf7faf-6395-4f7c-8851-4eee4b1efbb8 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0819416 Jun 17 11:06:47.263452 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7560b0d5-0a27-4f4e-927e-fb75367f2a47 req-94e468ed-ca53-4235-a163-6aad1d198761 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0450881 Jun 17 11:06:47.294788 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7899567', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8355178'] for router_interface, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:47.430275 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 3084d465-862a-4dca-ba25-6a98d0b14fbb no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:06:47.450566 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 3084d465-862a-4dca-ba25-6a98d0b14fbb {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:06:47.450944 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 3084d465-862a-4dca-ba25-6a98d0b14fbb not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:06:47.507911 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:06:47.611980 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:06:47.617155 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] 10.222.0.41 "PUT /v2.0/routers/08615a68-3696-4e03-8e4f-ea190d5c9ca6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0784433 Jun 17 11:06:47.619579 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39876) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:47.620266 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0bd5404-e658-4daf-a827-a606f854518c None None] Sync routers for ids ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:06:47.629936 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0bd5404-e658-4daf-a827-a606f854518c None None] Routers {'08615a68-3696-4e03-8e4f-ea190d5c9ca6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:47.630548 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d0bd5404-e658-4daf-a827-a606f854518c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:47.720651 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Notify callbacks [] for router, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:47.732876 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-d0bd5404-e658-4daf-a827-a606f854518c None None] Set router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:47.824566 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:47.913520 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d0bd5404-e658-4daf-a827-a606f854518c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221'}], 'enable_snat': True}, 'gw_port_id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:06:46Z', 'revision_number': 5, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port': {'id': 'd8093fa7-53de-468d-b6bd-e7335e5adfa9', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:38:2b:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 242, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:02Z', 'updated_at': '2021-06-17T11:01:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:47.933572 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Deleting port d8093fa7-53de-468d-b6bd-e7335e5adfa9 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:06:47.933907 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:47.940231 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0bd5404-e658-4daf-a827-a606f854518c None None] Checking router: 08615a68-3696-4e03-8e4f-ea190d5c9ca6 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:06:47.953962 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0bd5404-e658-4daf-a827-a606f854518c None None] Routers {'08615a68-3696-4e03-8e4f-ea190d5c9ca6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:47.954628 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d0bd5404-e658-4daf-a827-a606f854518c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:48.032877 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] For port d8093fa7-53de-468d-b6bd-e7335e5adfa9, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=d8093fa7-53de-468d-b6bd-e7335e5adfa9,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:48.033241 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:48.049558 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-d0bd5404-e658-4daf-a827-a606f854518c None None] Set router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 gateway port host: None {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:48.104702 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d0bd5404-e658-4daf-a827-a606f854518c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:06:47Z', 'revision_number': 6, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port_host': None}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:48.110606 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Calling delete_port for d8093fa7-53de-468d-b6bd-e7335e5adfa9 owned by network:router_gateway {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:06:48.135549 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0bd5404-e658-4daf-a827-a606f854518c None None] The sync data for ids ['08615a68-3696-4e03-8e4f-ea190d5c9ca6'] in dv-cinder-773870-6-iscsi is: [{'id': '08615a68-3696-4e03-8e4f-ea190d5c9ca6', 'name': 'tempest-TestShelveInstance-16191241-router', 'tenant_id': '6c4c0226eef34f24a2c7072aba63129d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:01Z', 'updated_at': '2021-06-17T11:06:47Z', 'revision_number': 6, 'project_id': '6c4c0226eef34f24a2c7072aba63129d', 'gw_port_host': None}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:06:48.360284 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:48.363311 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3e7d2c5c-20ce-4e27-aacb-d372db8d9ca8 tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:48.392748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Pushing event deleted for resources: {'Port': ['ID=d8093fa7-53de-468d-b6bd-e7335e5adfa9,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:48.395845 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:48.442432 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe14a6a9-0afc-44d6-bd9d-73dd3c680f8e req-8956e80d-feb3-4ff7-92be-9a1ee7b3c1a7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:48.443899 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fe14a6a9-0afc-44d6-bd9d-73dd3c680f8e req-8956e80d-feb3-4ff7-92be-9a1ee7b3c1a7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0677612 Jun 17 11:06:48.458405 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8286505'] for router_gateway, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:48.484537 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fe14a6a9-0afc-44d6-bd9d-73dd3c680f8e req-1229d407-ee4d-4c91-9996-d3e659a56517 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0346718 Jun 17 11:06:48.572330 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8357994', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2026'] for router, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:48.574457 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:48.702719 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8291427'] for router, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:48.703312 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 08615a68-3696-4e03-8e4f-ea190d5c9ca6 {{(pid=110215) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Jun 17 11:06:48.707969 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Notify callbacks [] for router, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:48.709089 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] 10.222.0.41 "DELETE /v2.0/routers/08615a68-3696-4e03-8e4f-ea190d5c9ca6 HTTP/1.1" status: 204 len: 168 time: 1.0886168 Jun 17 11:06:48.711525 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39884) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:48.754774 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_v2 [None req-bc82e473-57ed-41b8-a06e-60a1753752e7 admin admin] Deleting subnet 2567fd48-9bd6-4ffa-9d4c-72f989266554 {{(pid=110215) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:06:48.757927 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bc82e473-57ed-41b8-a06e-60a1753752e7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:48.795482 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bc82e473-57ed-41b8-a06e-60a1753752e7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6032829'] for subnet, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:48.902362 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bc82e473-57ed-41b8-a06e-60a1753752e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.051827 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bc82e473-57ed-41b8-a06e-60a1753752e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5898882', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5636066'] for subnet, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.056629 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c53826bf-7947-469a-9cf8-6227a310252d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:49.084130 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc82e473-57ed-41b8-a06e-60a1753752e7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2567fd48-9bd6-4ffa-9d4c-72f989266554,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:49.087187 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bc82e473-57ed-41b8-a06e-60a1753752e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:49.088166 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bc82e473-57ed-41b8-a06e-60a1753752e7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.093056 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39888) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:49.093271 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-bc82e473-57ed-41b8-a06e-60a1753752e7 admin admin] 10.222.0.41 "DELETE /v2.0/subnets/2567fd48-9bd6-4ffa-9d4c-72f989266554 HTTP/1.1" status: 204 len: 168 time: 0.3806007 Jun 17 11:06:49.096483 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95d60085-7ab0-4913-9540-4f8266785000 None None] Network 16bcab5c-7033-4cca-98e1-b173b2d78c2f requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:06:49.169526 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.227453 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Deleting port c84ed670-e254-4c75-8cc0-2207e5ad5322 {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:06:49.227778 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.289437 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] For port c84ed670-e254-4c75-8cc0-2207e5ad5322, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=c84ed670-e254-4c75-8cc0-2207e5ad5322,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:49.289661 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.295670 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfa1ec4a-0bc2-4e7b-a360-e4cd2942fc1d None None] DHCP port deletion for 16bcab5c-7033-4cca-98e1-b173b2d78c2f request from dv-cinder-773870-6-iscsi {{(pid=110216) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Jun 17 11:06:49.344128 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-bfa1ec4a-0bc2-4e7b-a360-e4cd2942fc1d None None] Deleting port c84ed670-e254-4c75-8cc0-2207e5ad5322 {{(pid=110216) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:06:49.344516 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-bfa1ec4a-0bc2-4e7b-a360-e4cd2942fc1d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.353619 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Calling delete_port for c84ed670-e254-4c75-8cc0-2207e5ad5322 owned by network:dhcp {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:06:49.417439 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-bfa1ec4a-0bc2-4e7b-a360-e4cd2942fc1d None None] For port c84ed670-e254-4c75-8cc0-2207e5ad5322, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=c84ed670-e254-4c75-8cc0-2207e5ad5322,segment=NetworkSegment(61eb1f0e-3387-4796-865e-caeb701082e6),segment_id=61eb1f0e-3387-4796-865e-caeb701082e6)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:49.417774 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-bfa1ec4a-0bc2-4e7b-a360-e4cd2942fc1d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.483333 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-bfa1ec4a-0bc2-4e7b-a360-e4cd2942fc1d None None] Calling delete_port for c84ed670-e254-4c75-8cc0-2207e5ad5322 owned by network:dhcp {{(pid=110216) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:06:49.502625 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.504983 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-1f6fffbb-6999-42ee-9b51-37e658c75af0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:49.531549 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Pushing event deleted for resources: {'Port': ['ID=c84ed670-e254-4c75-8cc0-2207e5ad5322,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:49.535066 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:49.537800 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] No DVR routers for this DVR port c84ed670-e254-4c75-8cc0-2207e5ad5322 on host dv-cinder-773870-6-iscsi {{(pid=110214) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:06:49.609857 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.610646 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-bfa1ec4a-0bc2-4e7b-a360-e4cd2942fc1d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159'] for port, after_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.612669 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-bb83854c-ba7b-41e2-8ba3-86e99e7c1b31 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:49.629540 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['16bcab5c-7033-4cca-98e1-b173b2d78c2f']}} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:49.634324 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfa1ec4a-0bc2-4e7b-a360-e4cd2942fc1d None None] Pushing event deleted for resources: {'Port': ['ID=c84ed670-e254-4c75-8cc0-2207e5ad5322,revision_number=None']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:49.638221 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-bfa1ec4a-0bc2-4e7b-a360-e4cd2942fc1d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:49.640961 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfa1ec4a-0bc2-4e7b-a360-e4cd2942fc1d None None] No DVR routers for this DVR port c84ed670-e254-4c75-8cc0-2207e5ad5322 on host dv-cinder-773870-6-iscsi {{(pid=110216) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:06:49.663098 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '61eb1f0e-3387-4796-865e-caeb701082e6') {'for_net_delete': True} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:49.663409 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '61eb1f0e-3387-4796-865e-caeb701082e6') {} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:49.675401 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6228436'] for segment, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.692112 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.701585 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Releasing vlan 137 on physical network physnet1 to pool {{(pid=110214) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6239464'] for segment, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: Traceback (most recent call last): Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: timer() Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: cb(*args, **kw) Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: return func(*args, **kwargs) Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: self._notify() Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: self.callback(batched_events) Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: event.method(event) Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: return f(self, *a, **k) Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._get(url).json() Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: return self.request(url, 'GET', **kwargs) Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:06:49.706576 dv-cinder-773870-6-iscsi neutron-server[110214]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:06:49.761675 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e75299bd-2cbb-46de-9cc9-5e173678635c req-392edb24-69b8-48d2-ab66-f6b368f0188c tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:49.763771 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e75299bd-2cbb-46de-9cc9-5e173678635c req-392edb24-69b8-48d2-ab66-f6b368f0188c tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.1509862 Jun 17 11:06:49.803464 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e75299bd-2cbb-46de-9cc9-5e173678635c req-b9dc5d23-2c7e-481c-a65d-b9fcb773a68e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0337734 Jun 17 11:06:49.874171 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.877784 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:49.880285 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:49.882046 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] 10.222.0.41 "DELETE /v2.0/networks/16bcab5c-7033-4cca-98e1-b173b2d78c2f HTTP/1.1" status: 204 len: 168 time: 0.7876561 Jun 17 11:06:49.885807 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39894) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:49.893662 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Pushing event deleted for resources: {'Network': ['ID=16bcab5c-7033-4cca-98e1-b173b2d78c2f,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:49.896176 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b4f9e6c6-cab9-43f1-97c9-ac0472f5bf7c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:50.160946 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d8093fa7-53de-468d-b6bd-e7335e5adfa9 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:06:50.184408 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: d8093fa7-53de-468d-b6bd-e7335e5adfa9 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:06:50.185265 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d8093fa7-53de-468d-b6bd-e7335e5adfa9 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:06:50.185696 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device c84ed670-e254-4c75-8cc0-2207e5ad5322 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:06:50.265314 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8355326'] for router_interface, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:50.325959 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: c84ed670-e254-4c75-8cc0-2207e5ad5322 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:06:50.326204 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device c84ed670-e254-4c75-8cc0-2207e5ad5322 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:06:50.326635 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device ae16d63a-186a-4b08-82b7-cde98ae2f1d5 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:06:50.345687 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: ae16d63a-186a-4b08-82b7-cde98ae2f1d5 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:06:50.346043 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device ae16d63a-186a-4b08-82b7-cde98ae2f1d5 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:06:50.656901 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8308a83f-269f-4377-b670-a1726b2cc8cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:50.794775 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Deleting port b77decc0-7ba4-46df-b003-b330aa03743f {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:06:50.795140 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:50.886938 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] For port b77decc0-7ba4-46df-b003-b330aa03743f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=b77decc0-7ba4-46df-b003-b330aa03743f,segment=NetworkSegment(fc102b61-79f9-42b1-a89b-28d6689dc41f),segment_id=fc102b61-79f9-42b1-a89b-28d6689dc41f)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:50.888161 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:50.961760 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Calling delete_port for b77decc0-7ba4-46df-b003-b330aa03743f owned by network:router_interface {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:06:50.990122 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebb71550-30cd-49f6-98d6-c779f2680779 req-5a486269-8be7-4924-85e7-3362293372da tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:50.991721 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ebb71550-30cd-49f6-98d6-c779f2680779 req-5a486269-8be7-4924-85e7-3362293372da tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0745111 Jun 17 11:06:51.043164 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ebb71550-30cd-49f6-98d6-c779f2680779 req-3d47c378-be1e-4999-97fe-9deb39ef9a71 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0423536 Jun 17 11:06:51.228955 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:51.231513 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-eac0f443-eee8-4431-9b0c-41f30862bc51 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:51.256232 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Pushing event deleted for resources: {'Port': ['ID=b77decc0-7ba4-46df-b003-b330aa03743f,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:51.259084 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:51.431651 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7899567', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8355178'] for router_interface, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:51.648362 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Router d1224a8c-31bd-435b-921a-53051bff5c2d has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:06:51.755170 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:06:51.760292 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] 10.222.0.41 "PUT /v2.0/routers/d1224a8c-31bd-435b-921a-53051bff5c2d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8728817 Jun 17 11:06:51.763176 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39904) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:51.764482 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f7990a4-3d52-4c0b-8b1c-182a758fe7d1 None None] Sync routers for ids ['d1224a8c-31bd-435b-921a-53051bff5c2d'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:06:51.773583 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f7990a4-3d52-4c0b-8b1c-182a758fe7d1 None None] Routers {'d1224a8c-31bd-435b-921a-53051bff5c2d'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:51.774201 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-9f7990a4-3d52-4c0b-8b1c-182a758fe7d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['d1224a8c-31bd-435b-921a-53051bff5c2d'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:51.865747 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Notify callbacks [] for router, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:51.879846 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-9f7990a4-3d52-4c0b-8b1c-182a758fe7d1 None None] Set router d1224a8c-31bd-435b-921a-53051bff5c2d gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:51.971000 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:52.066293 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-9f7990a4-3d52-4c0b-8b1c-182a758fe7d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'name': 'tempest-TestShelveInstance-1887644230-router', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:13Z', 'updated_at': '2021-06-17T11:06:51Z', 'revision_number': 5, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'gw_port': {'id': '6473d52e-e7b4-43df-8dd9-77c7e6b7586c', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:d6:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:01:15Z', 'updated_at': '2021-06-17T11:01:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:52.097865 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f7990a4-3d52-4c0b-8b1c-182a758fe7d1 None None] Checking router: d1224a8c-31bd-435b-921a-53051bff5c2d for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:06:52.109784 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f7990a4-3d52-4c0b-8b1c-182a758fe7d1 None None] Routers {'d1224a8c-31bd-435b-921a-53051bff5c2d'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:06:52.110637 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-9f7990a4-3d52-4c0b-8b1c-182a758fe7d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:06:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['d1224a8c-31bd-435b-921a-53051bff5c2d'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:52.132672 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Deleting port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:06:52.133601 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:52.217820 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-9f7990a4-3d52-4c0b-8b1c-182a758fe7d1 None None] Set router d1224a8c-31bd-435b-921a-53051bff5c2d gateway port host: None {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:06:52.266223 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] For port 6473d52e-e7b4-43df-8dd9-77c7e6b7586c, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=6473d52e-e7b4-43df-8dd9-77c7e6b7586c,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:52.266653 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:52.275014 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-9f7990a4-3d52-4c0b-8b1c-182a758fe7d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'name': 'tempest-TestShelveInstance-1887644230-router', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:13Z', 'updated_at': '2021-06-17T11:06:51Z', 'revision_number': 6, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'gw_port_host': None}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:52.280314 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b6df6f-436e-4900-b3ea-8fb661f39d1a req-f4221df3-0e34-4723-bd28-73404d3918d2 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:52.286613 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a6b6df6f-436e-4900-b3ea-8fb661f39d1a req-f4221df3-0e34-4723-bd28-73404d3918d2 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0924058 Jun 17 11:06:52.308112 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f7990a4-3d52-4c0b-8b1c-182a758fe7d1 None None] The sync data for ids ['d1224a8c-31bd-435b-921a-53051bff5c2d'] in dv-cinder-773870-6-iscsi is: [{'id': 'd1224a8c-31bd-435b-921a-53051bff5c2d', 'name': 'tempest-TestShelveInstance-1887644230-router', 'tenant_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:01:13Z', 'updated_at': '2021-06-17T11:06:51Z', 'revision_number': 6, 'project_id': '5b0bcf5e58ad4566ac164c2850ea7947', 'gw_port_host': None}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:06:52.331505 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a6b6df6f-436e-4900-b3ea-8fb661f39d1a req-3fc831cd-4440-453a-b778-295df317de83 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0439875 Jun 17 11:06:52.347739 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Calling delete_port for 6473d52e-e7b4-43df-8dd9-77c7e6b7586c owned by network:router_gateway {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:06:52.611632 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:52.614172 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0d3834de-4f67-471a-b3c5-dc807a31e78a tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:52.640516 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Pushing event deleted for resources: {'Port': ['ID=6473d52e-e7b4-43df-8dd9-77c7e6b7586c,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:52.643895 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:52.731480 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8286505'] for router_gateway, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:52.860977 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8357994', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2026'] for router, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:52.863523 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:52.971704 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8291427'] for router, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:52.972397 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d1224a8c-31bd-435b-921a-53051bff5c2d {{(pid=110215) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Jun 17 11:06:52.977027 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Notify callbacks [] for router, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:52.984888 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] 10.222.0.41 "DELETE /v2.0/routers/d1224a8c-31bd-435b-921a-53051bff5c2d HTTP/1.1" status: 204 len: 168 time: 1.2140908 Jun 17 11:06:52.984888 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39912) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:53.026565 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_v2 [None req-4cf3c65f-d5be-4202-8a19-eee27beb88c8 admin admin] Deleting subnet 256f465c-ee93-4a3f-94ca-01e6c1e1c6be {{(pid=110215) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:06:53.029729 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4cf3c65f-d5be-4202-8a19-eee27beb88c8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.070959 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4cf3c65f-d5be-4202-8a19-eee27beb88c8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6032829'] for subnet, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.152536 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4cf3c65f-d5be-4202-8a19-eee27beb88c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.269072 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4cf3c65f-d5be-4202-8a19-eee27beb88c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5898882', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5636066'] for subnet, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.271687 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:53.300235 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7003875f-4a44-4d24-9886-513edf8d3fa9 None None] Network 4b6ea264-79c3-4ec1-8e3b-80abbb760608 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:06:53.304727 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4cf3c65f-d5be-4202-8a19-eee27beb88c8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.306566 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-4cf3c65f-d5be-4202-8a19-eee27beb88c8 admin admin] 10.222.0.41 "DELETE /v2.0/subnets/256f465c-ee93-4a3f-94ca-01e6c1e1c6be HTTP/1.1" status: 204 len: 168 time: 0.3249412 Jun 17 11:06:53.308081 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cf3c65f-d5be-4202-8a19-eee27beb88c8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=256f465c-ee93-4a3f-94ca-01e6c1e1c6be,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:53.309950 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39918) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:53.321327 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4cf3c65f-d5be-4202-8a19-eee27beb88c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:53.345360 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-62fb5899-118e-4b32-941b-8ae2013a7509 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.415092 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.498303 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Deleting port 28d54020-2e2c-4d89-8549-d0c51f50701f {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:06:53.498522 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.550786 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7a8b39d-bc51-43f6-8689-ffc104bce60e None None] DHCP port deletion for 4b6ea264-79c3-4ec1-8e3b-80abbb760608 request from dv-cinder-773870-6-iscsi {{(pid=110216) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Jun 17 11:06:53.601889 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-c7a8b39d-bc51-43f6-8689-ffc104bce60e None None] Deleting port 28d54020-2e2c-4d89-8549-d0c51f50701f {{(pid=110216) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:06:53.602416 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-c7a8b39d-bc51-43f6-8689-ffc104bce60e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.604287 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.675786 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-c7a8b39d-bc51-43f6-8689-ffc104bce60e None None] For port 28d54020-2e2c-4d89-8549-d0c51f50701f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=28d54020-2e2c-4d89-8549-d0c51f50701f,segment=NetworkSegment(fc102b61-79f9-42b1-a89b-28d6689dc41f),segment_id=fc102b61-79f9-42b1-a89b-28d6689dc41f)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:53.676092 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-c7a8b39d-bc51-43f6-8689-ffc104bce60e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.751543 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-c7a8b39d-bc51-43f6-8689-ffc104bce60e None None] Calling delete_port for 28d54020-2e2c-4d89-8549-d0c51f50701f owned by network:dhcp {{(pid=110216) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:06:53.820136 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] For port 28d54020-2e2c-4d89-8549-d0c51f50701f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=28d54020-2e2c-4d89-8549-d0c51f50701f,segment=NetworkSegment(fc102b61-79f9-42b1-a89b-28d6689dc41f),segment_id=fc102b61-79f9-42b1-a89b-28d6689dc41f)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:06:53.820535 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.841130 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43f935e6-e939-40f6-80e1-c09ce8b0804c req-87a478fc-63cd-4eb6-8379-d02fde1454d6 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:53.842607 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-43f935e6-e939-40f6-80e1-c09ce8b0804c req-87a478fc-63cd-4eb6-8379-d02fde1454d6 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.3867409 Jun 17 11:06:53.896223 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Calling delete_port for 28d54020-2e2c-4d89-8549-d0c51f50701f owned by network:dhcp {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:06:53.919547 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-c7a8b39d-bc51-43f6-8689-ffc104bce60e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159'] for port, after_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:53.922430 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:53.946752 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a8b39d-bc51-43f6-8689-ffc104bce60e None None] Pushing event deleted for resources: {'Port': ['ID=28d54020-2e2c-4d89-8549-d0c51f50701f,revision_number=None']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:53.949272 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7a8b39d-bc51-43f6-8689-ffc104bce60e None None] No DVR routers for this DVR port 28d54020-2e2c-4d89-8549-d0c51f50701f on host dv-cinder-773870-6-iscsi {{(pid=110216) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:06:53.951264 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-c7a8b39d-bc51-43f6-8689-ffc104bce60e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:53.971622 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-43f935e6-e939-40f6-80e1-c09ce8b0804c req-598cf1db-72d5-473a-ab80-94b17f78ba01 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1002264 Jun 17 11:06:54.006243 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:54.008539 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fd863b2f-9c61-4ea4-97e2-b63e58ac99fa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:54.030997 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Pushing event deleted for resources: {'Port': ['ID=28d54020-2e2c-4d89-8549-d0c51f50701f,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:54.037348 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:54.039692 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] No DVR routers for this DVR port 28d54020-2e2c-4d89-8549-d0c51f50701f on host dv-cinder-773870-6-iscsi {{(pid=110214) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:06:54.113936 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:54.121903 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4b6ea264-79c3-4ec1-8e3b-80abbb760608']}} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:54.132578 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fc102b61-79f9-42b1-a89b-28d6689dc41f') {'for_net_delete': True} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:54.132869 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fc102b61-79f9-42b1-a89b-28d6689dc41f') {} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:06:54.142313 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6228436'] for segment, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:54.161303 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 28d54020-2e2c-4d89-8549-d0c51f50701f no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:06:54.161479 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:54.167781 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Releasing vlan 105 on physical network physnet1 to pool {{(pid=110214) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:06:54.167972 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6239464'] for segment, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:680: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: self.session.flush() Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:680: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: self.session.flush() Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:680: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: self.session.flush() Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:680: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: self.session.flush() Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: Traceback (most recent call last): Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: timer() Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: cb(*args, **kw) Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: return func(*args, **kwargs) Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: self._notify() Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: self.callback(batched_events) Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: event.method(event) Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: return f(self, *a, **k) Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._get(url).json() Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: return self.request(url, 'GET', **kwargs) Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:06:54.169732 dv-cinder-773870-6-iscsi neutron-server[110214]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:06:54.181728 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 28d54020-2e2c-4d89-8549-d0c51f50701f {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:06:54.182086 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 28d54020-2e2c-4d89-8549-d0c51f50701f not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:06:54.182526 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 6473d52e-e7b4-43df-8dd9-77c7e6b7586c no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:06:54.202370 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 6473d52e-e7b4-43df-8dd9-77c7e6b7586c {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:06:54.202667 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 6473d52e-e7b4-43df-8dd9-77c7e6b7586c not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:06:54.203129 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device b77decc0-7ba4-46df-b003-b330aa03743f no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:06:54.224492 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: b77decc0-7ba4-46df-b003-b330aa03743f {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:06:54.224776 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device b77decc0-7ba4-46df-b003-b330aa03743f not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:06:54.354311 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:54.359139 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:54.361893 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:54.366335 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] 10.222.0.41 "DELETE /v2.0/networks/4b6ea264-79c3-4ec1-8e3b-80abbb760608 HTTP/1.1" status: 204 len: 168 time: 1.0519757 Jun 17 11:06:54.386976 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Pushing event deleted for resources: {'Network': ['ID=4b6ea264-79c3-4ec1-8e3b-80abbb760608,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:54.389861 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:54.473884 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:54.744599 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39936) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:54.786569 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-ddb70842-feae-4711-8b26-fe804318b7ef admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=6c4c0226eef34f24a2c7072aba63129d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0407231 Jun 17 11:06:54.789082 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39938) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:54.839109 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5f305ba1-81be-4d0a-8dd0-399bdd4484f6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:54.859196 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5f305ba1-81be-4d0a-8dd0-399bdd4484f6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:55.022756 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5f305ba1-81be-4d0a-8dd0-399bdd4484f6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:55.025386 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-5f305ba1-81be-4d0a-8dd0-399bdd4484f6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:55.026709 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-5f305ba1-81be-4d0a-8dd0-399bdd4484f6 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/4d8be6c1-6b50-4ccd-ac50-3296ffc1ea90 HTTP/1.1" status: 204 len: 168 time: 0.2365909 Jun 17 11:06:55.027731 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb7a-4aea-4692-ba07-6221482e0420 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:55.035822 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f305ba1-81be-4d0a-8dd0-399bdd4484f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d8be6c1-6b50-4ccd-ac50-3296ffc1ea90,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:55.038246 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5f305ba1-81be-4d0a-8dd0-399bdd4484f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:55.154448 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f7fe15-85c7-42b3-b87c-16604b3f4ef9 req-61ff3b25-76fa-43c0-9c83-7f948d368304 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:55.155947 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-12f7fe15-85c7-42b3-b87c-16604b3f4ef9 req-61ff3b25-76fa-43c0-9c83-7f948d368304 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0659471 Jun 17 11:06:55.196045 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-12f7fe15-85c7-42b3-b87c-16604b3f4ef9 req-965d3677-2cc4-4d0e-9c0c-0ee4fbefe769 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0339446 Jun 17 11:06:55.741383 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 39954) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:55.785147 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-8d1335cd-e02c-4445-828e-58cfcb0ec1ef admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=5b0bcf5e58ad4566ac164c2850ea7947&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0424447 Jun 17 11:06:55.787680 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 39956) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:06:55.842626 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8afb3be8-898b-4d25-817c-33f954222a44 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:55.862765 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8afb3be8-898b-4d25-817c-33f954222a44 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:55.988531 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8afb3be8-898b-4d25-817c-33f954222a44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:55.991146 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8afb3be8-898b-4d25-817c-33f954222a44 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:55.992279 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-8afb3be8-898b-4d25-817c-33f954222a44 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/bbcc31b4-116f-48ff-a757-ad5daae672a9 HTTP/1.1" status: 204 len: 168 time: 0.2032678 Jun 17 11:06:55.993034 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:06:56.001147 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8afb3be8-898b-4d25-817c-33f954222a44 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bbcc31b4-116f-48ff-a757-ad5daae672a9,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:06:56.003664 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-8afb3be8-898b-4d25-817c-33f954222a44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:06:56.383469 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6f7cc9-7d1c-423c-8aea-c3ddecd71293 req-24ba36fb-6db8-4a20-8ec5-2406b2b8698c tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:56.385067 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3b6f7cc9-7d1c-423c-8aea-c3ddecd71293 req-24ba36fb-6db8-4a20-8ec5-2406b2b8698c tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0796409 Jun 17 11:06:56.432247 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3b6f7cc9-7d1c-423c-8aea-c3ddecd71293 req-585f56f6-a2d7-4110-8c7a-a31a7e640c94 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0391576 Jun 17 11:06:56.816783 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:06:57.622253 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b16127bd-feb9-4661-ad98-dd7730ea95c8 req-af7a2315-1ac0-4f97-b4bc-ba2f215dbc8b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:57.623737 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b16127bd-feb9-4661-ad98-dd7730ea95c8 req-af7a2315-1ac0-4f97-b4bc-ba2f215dbc8b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0687466 Jun 17 11:06:57.666726 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b16127bd-feb9-4661-ad98-dd7730ea95c8 req-8082e86f-e613-43d1-843d-16d5543f32f7 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0370963 Jun 17 11:06:58.842400 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd511d51-d705-4433-9e45-ecf005b3782e req-8a21e3bd-6784-42eb-be56-7e9e80c165b4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:06:58.843969 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-cd511d51-d705-4433-9e45-ecf005b3782e req-8a21e3bd-6784-42eb-be56-7e9e80c165b4 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0650713 Jun 17 11:06:58.882922 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-cd511d51-d705-4433-9e45-ecf005b3782e req-3804e48f-6018-433a-a458-cf9b52a31bf2 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0331352 Jun 17 11:07:00.060761 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c220a00-80b0-4ad8-8a41-c203cc04e188 req-bc860d1e-8424-4684-9b0c-4802f97da68f tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:00.062237 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5c220a00-80b0-4ad8-8a41-c203cc04e188 req-bc860d1e-8424-4684-9b0c-4802f97da68f tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0681362 Jun 17 11:07:00.103787 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5c220a00-80b0-4ad8-8a41-c203cc04e188 req-8c8145bd-96a7-46ef-bf9b-8708a026a246 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0356402 Jun 17 11:07:01.281843 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b5fa61-0ee4-42f7-ae29-f837752a1e96 req-68006112-9faf-47a0-a98c-fa479b1ca255 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:01.283356 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d4b5fa61-0ee4-42f7-ae29-f837752a1e96 req-68006112-9faf-47a0-a98c-fa479b1ca255 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0680485 Jun 17 11:07:01.323501 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d4b5fa61-0ee4-42f7-ae29-f837752a1e96 req-b55f603b-488e-4e42-9ad9-c4d78508058d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0344486 Jun 17 11:07:02.495886 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b098b36-0856-4f31-bdd2-1642f8a2c68f req-f7ba7fa7-6641-4e27-8e17-5e68b9914374 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:02.497316 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4b098b36-0856-4f31-bdd2-1642f8a2c68f req-f7ba7fa7-6641-4e27-8e17-5e68b9914374 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0615377 Jun 17 11:07:02.541245 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4b098b36-0856-4f31-bdd2-1642f8a2c68f req-1ddabd35-6f19-4bf8-ad6f-c606b2cfa4c6 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=e981b014-56d8-44c5-8806-e0c8684083c6&id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0382373 Jun 17 11:07:06.263346 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-a8cf90e8-25a3-464a-9ec5-bbfa5fad651b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1961343052&fields=id&tenant_id=a7706f138ac3465ba5820edf148d8153 HTTP/1.1" status: 200 len: 267 time: 0.0340431 Jun 17 11:07:06.377454 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-2a882269-fcd3-4f0d-9ab1-7a85aa5672d2 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:06.379010 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-2a882269-fcd3-4f0d-9ab1-7a85aa5672d2 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 812 time: 0.1023316 Jun 17 11:07:06.393824 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-37ad6205-f1a9-4072-ad6e-54e30c033737 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/quotas/a7706f138ac3465ba5820edf148d8153 HTTP/1.1" status: 200 len: 375 time: 0.0090656 Jun 17 11:07:06.461385 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-5393cac9-b388-47ee-91d8-039db3d616be tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0622656 Jun 17 11:07:06.564429 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-c88ea6b1-519b-4175-acd5-2f35bf509f46 service neutron] 10.222.0.41 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887861 Jun 17 11:07:06.653356 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-11775437-51de-48b6-a1f2-841d2e2f3ec6 service neutron] 10.222.0.41 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814450 Jun 17 11:07:07.222054 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c41a9ada-2819-419b-a4c4-41a50ae334ea req-b4bbf1f4-f681-4be3-bbf1-a821fd3e9f07 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 210 time: 0.0291040 Jun 17 11:07:07.668139 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:08.372657 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-620aacb1-e638-4381-97e1-2846059e2ea5 req-9ef3af14-32d6-4209-bdd8-2e23356c726b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 210 time: 0.0282736 Jun 17 11:07:09.512306 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cab7a7ba-2117-4243-8e04-95e7aa23aff3 req-9aa75936-082c-4045-abf9-4954df226a82 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 210 time: 0.0276558 Jun 17 11:07:09.677756 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-b27af349-48d3-4f40-a5aa-03138b093c28 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:09.679583 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-b27af349-48d3-4f40-a5aa-03138b093c28 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 812 time: 0.1235397 Jun 17 11:07:09.735691 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-8b47b4e2-a0f6-4631-b3c0-dd8b28045f0a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a7706f138ac3465ba5820edf148d8153 HTTP/1.1" status: 200 len: 380 time: 0.0421875 Jun 17 11:07:09.744692 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'port': {'device_id': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'admin_state_up': True, 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'security_groups': ['3b3dcbc2-41c2-439d-a885-9ba22ead5a7e']}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:07:09.970708 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Made reservation on behalf of a7706f138ac3465ba5820edf148d8153 for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:07:09.974253 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:10.095201 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Allocated IP 172.20.0.8 (79f5bf09-f965-46d9-8615-13aab136e8eb/1df800fd-de2b-4d27-b603-4af981229332/32ccdb21-38fc-43ce-babf-60a38df225e7) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:07:10.232467 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:10.246252 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Transition to ACTIVE for port object 32ccdb21-38fc-43ce-babf-60a38df225e7 will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:07:10.348518 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:10.352990 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-968b03ad-fe33-4375-a9b7-fe9a2e573e3a tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:10.393295 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Network 79f5bf09-f965-46d9-8615-13aab136e8eb is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:07:10.396311 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:07:10.398923 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:07:10.431317 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'Port': ['ID=32ccdb21-38fc-43ce-babf-60a38df225e7,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:10.445821 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.446740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.446740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.447177 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.447382 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.447735 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.448085 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.448434 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.448781 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.449134 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.449471 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.449815 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:10.454882 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:10.471835 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:10.472515 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:10.571793 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8308411 Jun 17 11:07:10.585490 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Request body: {'port': {'device_id': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:07:10.684056 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-792ec319-250b-4ae8-9cae-62fcb0f3066e None None] Provisioning for port 32ccdb21-38fc-43ce-babf-60a38df225e7 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:07:10.686720 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:10.691107 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-792ec319-250b-4ae8-9cae-62fcb0f3066e None None] Provisioning complete for port 32ccdb21-38fc-43ce-babf-60a38df225e7 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:07:10.696569 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-792ec319-250b-4ae8-9cae-62fcb0f3066e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:10.725019 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-792ec319-250b-4ae8-9cae-62fcb0f3066e None None] Port 32ccdb21-38fc-43ce-babf-60a38df225e7 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:07:10.764039 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3be62219-514c-4cb0-8c3d-d52259401133 req-900756be-e9da-4809-af30-a29286163900 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:10.765398 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3be62219-514c-4cb0-8c3d-d52259401133 req-900756be-e9da-4809-af30-a29286163900 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 931 time: 0.1207674 Jun 17 11:07:10.864226 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3be62219-514c-4cb0-8c3d-d52259401133 req-7d90377a-08ca-4777-b94f-e9dd26ad834d tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0583937 Jun 17 11:07:10.985898 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 32ccdb21-38fc-43ce-babf-60a38df225e7 {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:07:10.992987 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:11.005564 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Transition to ACTIVE for port object 32ccdb21-38fc-43ce-babf-60a38df225e7 will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:07:11.049980 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:07:11.108517 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:11.110691 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-72a736b8-5e36-43ac-bc09-6ef13507c4a9 tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:11.184500 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Pushing event updated for resources: {'Port': ['ID=32ccdb21-38fc-43ce-babf-60a38df225e7,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:11.188706 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:11.259183 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Attempting to bind port 32ccdb21-38fc-43ce-babf-60a38df225e7 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:07:11.259521 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Attempting to bind port 32ccdb21-38fc-43ce-babf-60a38df225e7 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:07:11.260045 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Attempting to bind port 32ccdb21-38fc-43ce-babf-60a38df225e7 on network 79f5bf09-f965-46d9-8615-13aab136e8eb {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:07:11.264599 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Port 32ccdb21-38fc-43ce-babf-60a38df225e7 on network 79f5bf09-f965-46d9-8615-13aab136e8eb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:07:11.264925 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Attempting to bind port 32ccdb21-38fc-43ce-babf-60a38df225e7 on network 79f5bf09-f965-46d9-8615-13aab136e8eb {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:07:11.269832 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 7, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:07:11.270208 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Checking segment: {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:07:11.270532 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Bound using segment: {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:07:11.270999 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Bound port: 32ccdb21-38fc-43ce-babf-60a38df225e7, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:07:11.271340 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:11.333327 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] For port 32ccdb21-38fc-43ce-babf-60a38df225e7, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:07:11.336293 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] For port 32ccdb21-38fc-43ce-babf-60a38df225e7, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=32ccdb21-38fc-43ce-babf-60a38df225e7,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:07:11.428657 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:11.431629 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-09758e55-3b0e-4b48-9a19-60ecec37cf4b tempest-ServerRescueNegativeTestJSON-907727928 tempest-ServerRescueNegativeTestJSON-907727928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:11.465955 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:11.466603 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:11.468512 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] 10.222.0.25 "PUT /v2.0/ports/32ccdb21-38fc-43ce-babf-60a38df225e7 HTTP/1.1" status: 200 len: 1093 time: 0.8894904 Jun 17 11:07:11.472331 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'tag': '32ccdb21-38fc-43ce-babf-60a38df225e7'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:07:11.472331 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-03e60cc4-65f5-40e1-9b39-2c555e40eb98" -d '{"events": [{"name": "network-changed", "server_uuid": "cc31593d-01b6-4451-8ed4-dcacc7dd1852", "tag": "32ccdb21-38fc-43ce-babf-60a38df225e7"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:07:11.507522 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Pushing event updated for resources: {'Port': ['ID=32ccdb21-38fc-43ce-babf-60a38df225e7,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:11.508063 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:11.510313 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:07:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34d2e51e-144c-4397-946d-865ea656abf4 x-openstack-request-id: req-34d2e51e-144c-4397-946d-865ea656abf4 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:07:11.510637 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cc31593d-01b6-4451-8ed4-dcacc7dd1852", "tag": "32ccdb21-38fc-43ce-babf-60a38df225e7", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:07:11.510960 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-34d2e51e-144c-4397-946d-865ea656abf4 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:07:11.511418 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'tag': '32ccdb21-38fc-43ce-babf-60a38df225e7', 'status': 'completed', 'code': 200} Jun 17 11:07:11.585443 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e60cc4-65f5-40e1-9b39-2c555e40eb98 req-57177154-17ed-4b13-9567-e7b2f84d0ca6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:11.586899 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-03e60cc4-65f5-40e1-9b39-2c555e40eb98 req-57177154-17ed-4b13-9567-e7b2f84d0ca6 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 1096 time: 0.0545132 Jun 17 11:07:11.690730 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e60cc4-65f5-40e1-9b39-2c555e40eb98 req-6a6437ed-4637-4638-8483-979cb8f214e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:11.692203 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-03e60cc4-65f5-40e1-9b39-2c555e40eb98 req-6a6437ed-4637-4638-8483-979cb8f214e0 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=a7706f138ac3465ba5820edf148d8153&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0957727 Jun 17 11:07:12.042453 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62757dc4-2742-4c68-90dc-e7236dcfdea1 req-1a45a08a-260a-4d5f-9f85-d655676378a3 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:12.043934 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-62757dc4-2742-4c68-90dc-e7236dcfdea1 req-1a45a08a-260a-4d5f-9f85-d655676378a3 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 943 time: 0.0649469 Jun 17 11:07:12.050361 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e60cc4-65f5-40e1-9b39-2c555e40eb98 req-b6f62507-1193-4eee-bfa2-9facb32254c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:12.051868 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-03e60cc4-65f5-40e1-9b39-2c555e40eb98 req-b6f62507-1193-4eee-bfa2-9facb32254c6 service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3527997 Jun 17 11:07:12.081191 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-62757dc4-2742-4c68-90dc-e7236dcfdea1 req-881f9fe5-8efd-4ecf-b78f-df5af346e90b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306211 Jun 17 11:07:12.141899 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-fee73bb7-8112-4069-8184-a1bba204c8c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:12.143420 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-fee73bb7-8112-4069-8184-a1bba204c8c7 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 1096 time: 0.0521021 Jun 17 11:07:12.188398 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-aa4be41b-cd1e-4a26-8159-38b9ef8ef2fe service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=32ccdb21-38fc-43ce-babf-60a38df225e7 HTTP/1.1" status: 200 len: 217 time: 0.0367022 Jun 17 11:07:12.236877 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-1694e6ad-f0d3-4b67-a517-b7cd6cb040d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:12.238378 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-1694e6ad-f0d3-4b67-a517-b7cd6cb040d8 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0442436 Jun 17 11:07:12.301811 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-37c95e2b-dbd9-4cd7-8cde-d04b34b129bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:12.303313 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-37c95e2b-dbd9-4cd7-8cde-d04b34b129bc service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0574884 Jun 17 11:07:12.393597 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-392a3f22-e302-4b48-9555-8ea57ece3983 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831513 Jun 17 11:07:12.482340 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-497fb305-6e1f-4e87-9f45-cba9eee78f74 req-5aed819f-0f45-438b-b149-982751ee5eb8 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817792 Jun 17 11:07:13.253949 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-005cb0f5-a161-48bd-8772-bb346eabfad5 req-854b7f5a-14a7-4947-91d1-d1f7fc1a3b5e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:13.255545 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-005cb0f5-a161-48bd-8772-bb346eabfad5 req-854b7f5a-14a7-4947-91d1-d1f7fc1a3b5e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 943 time: 0.0624456 Jun 17 11:07:13.293316 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-005cb0f5-a161-48bd-8772-bb346eabfad5 req-6b6af5c2-0b12-4d91-8a25-d3ed970c4f5a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319917 Jun 17 11:07:14.461476 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed8686b3-008e-4c1e-8d79-95c0bc955633 req-46a7f84b-4bb8-459d-a29e-076f095c5d10 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:14.462825 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ed8686b3-008e-4c1e-8d79-95c0bc955633 req-46a7f84b-4bb8-459d-a29e-076f095c5d10 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 943 time: 0.0618520 Jun 17 11:07:14.507404 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ed8686b3-008e-4c1e-8d79-95c0bc955633 req-b884599b-bda9-40a7-a0f6-9d17064b7f50 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0345619 Jun 17 11:07:15.690325 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935461a8-45b4-407e-bf11-bc4e77a3f875 req-988f21ab-b685-4b10-8be2-61a9c3106ead tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:15.691863 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-935461a8-45b4-407e-bf11-bc4e77a3f875 req-988f21ab-b685-4b10-8be2-61a9c3106ead tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 943 time: 0.0735769 Jun 17 11:07:15.729985 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-935461a8-45b4-407e-bf11-bc4e77a3f875 req-34ed3a8d-fac0-47a6-8498-1dda39f90d01 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318339 Jun 17 11:07:16.900173 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18d63fd2-3d0f-47cd-83d6-b7b0e98124fb req-d29c4974-c8a4-4e95-be14-9146d41ba355 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:16.901603 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18d63fd2-3d0f-47cd-83d6-b7b0e98124fb req-d29c4974-c8a4-4e95-be14-9146d41ba355 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 943 time: 0.0611873 Jun 17 11:07:16.938453 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-18d63fd2-3d0f-47cd-83d6-b7b0e98124fb req-c4c101a6-3e0a-4285-a9af-e3063b62256b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0302126 Jun 17 11:07:18.110283 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac1ca139-6350-4658-b54a-5fbe3abd2f81 req-64667b49-0a0b-48ab-8cd7-f7cd6ccb26fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:18.111784 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ac1ca139-6350-4658-b54a-5fbe3abd2f81 req-64667b49-0a0b-48ab-8cd7-f7cd6ccb26fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 943 time: 0.0627465 Jun 17 11:07:18.148081 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ac1ca139-6350-4658-b54a-5fbe3abd2f81 req-e1d9211d-673b-42ef-a44a-765b9eb5d81b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0305672 Jun 17 11:07:18.498993 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04bcea0b-bb5d-4054-91b1-c4ca0b0d28a9 req-0edce949-bc90-44d6-a37a-1ca0720742f5 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:18.500423 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-04bcea0b-bb5d-4054-91b1-c4ca0b0d28a9 req-0edce949-bc90-44d6-a37a-1ca0720742f5 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0672657 Jun 17 11:07:18.538183 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-04bcea0b-bb5d-4054-91b1-c4ca0b0d28a9 req-dc249c9d-46d4-446a-b5cd-33cf3fd95c45 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319524 Jun 17 11:07:19.317676 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a345f5ab-3806-4f56-9d77-d0a173c66ed2 req-4371649f-5377-43ca-a93a-29f439f68b54 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:19.319124 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a345f5ab-3806-4f56-9d77-d0a173c66ed2 req-4371649f-5377-43ca-a93a-29f439f68b54 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 943 time: 0.0611384 Jun 17 11:07:19.355448 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a345f5ab-3806-4f56-9d77-d0a173c66ed2 req-f37b8489-0453-4a07-b66e-6fa6da40bda6 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306530 Jun 17 11:07:19.711741 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998992b4-a9be-4985-bd57-f0c0451ffe82 req-23e771eb-b77b-41dd-9697-081ba2d81b9a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:19.713206 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-998992b4-a9be-4985-bd57-f0c0451ffe82 req-23e771eb-b77b-41dd-9697-081ba2d81b9a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0625181 Jun 17 11:07:19.749371 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-998992b4-a9be-4985-bd57-f0c0451ffe82 req-5a53ca45-d874-4bcc-971e-77b234e4fcc0 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0299618 Jun 17 11:07:20.529964 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efc4c320-91eb-4a8a-a277-49ffb8063204 req-6d30d249-187d-4148-8ca3-ad2850fae890 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:20.531524 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-efc4c320-91eb-4a8a-a277-49ffb8063204 req-6d30d249-187d-4148-8ca3-ad2850fae890 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 943 time: 0.0664654 Jun 17 11:07:20.567408 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-efc4c320-91eb-4a8a-a277-49ffb8063204 req-85ead56e-e2e0-4952-9fce-2d265c495063 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0302231 Jun 17 11:07:20.643990 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f3b316ea-de8f-48a5-b81c-b6b99a441cd1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:20.925183 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56b1c34-1373-4752-ba11-b328421d061e req-d5ce72c5-e898-4c65-bf5c-fe70f191f0d4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:20.926569 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e56b1c34-1373-4752-ba11-b328421d061e req-d5ce72c5-e898-4c65-bf5c-fe70f191f0d4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0626125 Jun 17 11:07:20.968059 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e56b1c34-1373-4752-ba11-b328421d061e req-bae970ae-b97e-4024-b5c9-2835d870d704 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0356295 Jun 17 11:07:21.571342 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 32ccdb21-38fc-43ce-babf-60a38df225e7 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:07:21.671554 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 32ccdb21-38fc-43ce-babf-60a38df225e7, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=32ccdb21-38fc-43ce-babf-60a38df225e7,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:07:21.683077 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '32ccdb21-38fc-43ce-babf-60a38df225e7', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'port_id': '32ccdb21-38fc-43ce-babf-60a38df225e7', 'mac_address': 'fa:16:3e:03:91:d5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 135, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:07:21.720458 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:21.734197 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 32ccdb21-38fc-43ce-babf-60a38df225e7 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:07:21.754073 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 32ccdb21-38fc-43ce-babf-60a38df225e7, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=32ccdb21-38fc-43ce-babf-60a38df225e7,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:07:21.759880 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44bbba80-8847-4c48-bd69-3268745b78ca req-cd4c61dd-a75d-466b-9dc8-7653ab0bc537 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:21.766221 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44bbba80-8847-4c48-bd69-3268745b78ca req-cd4c61dd-a75d-466b-9dc8-7653ab0bc537 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 943 time: 0.0635750 Jun 17 11:07:21.802342 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-44bbba80-8847-4c48-bd69-3268745b78ca req-70a2b957-f5a6-4540-8516-78326809a5af tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0348718 Jun 17 11:07:21.845022 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:21.847747 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:21.895746 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=32ccdb21-38fc-43ce-babf-60a38df225e7,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:21.898876 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:22.146416 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05efb198-75d2-4e99-947e-9e6f9f08d5b5 req-a203a5e5-662b-4eb9-b5d3-8a874b13b016 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:22.147891 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-05efb198-75d2-4e99-947e-9e6f9f08d5b5 req-a203a5e5-662b-4eb9-b5d3-8a874b13b016 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0618606 Jun 17 11:07:22.184753 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-05efb198-75d2-4e99-947e-9e6f9f08d5b5 req-e5278b2f-896c-49dd-adf6-3e9d187af41f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312610 Jun 17 11:07:22.266901 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['32ccdb21-38fc-43ce-babf-60a38df225e7'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:07:22.986016 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ad2303-5766-4c9d-a4ca-0cff03d858f7 req-cda5173b-8107-467a-8dff-d193083309fb tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:22.987530 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-48ad2303-5766-4c9d-a4ca-0cff03d858f7 req-cda5173b-8107-467a-8dff-d193083309fb tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 944 time: 0.0692537 Jun 17 11:07:23.024877 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-48ad2303-5766-4c9d-a4ca-0cff03d858f7 req-25aec732-6fd8-4a7f-b1cf-53ca21de1c8b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317833 Jun 17 11:07:23.365914 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e70117c-670d-4402-8a2a-8ba44d28ee70 req-a5364efa-7411-4b52-88a5-ef91b05f08fe tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:23.367392 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8e70117c-670d-4402-8a2a-8ba44d28ee70 req-a5364efa-7411-4b52-88a5-ef91b05f08fe tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0648551 Jun 17 11:07:23.394162 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-cd9c12df-22cd-48ac-b689-f6a6f61fcc2d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:23.406783 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8e70117c-670d-4402-8a2a-8ba44d28ee70 req-b5127810-0e4e-46da-b364-c9bfea473d64 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0333264 Jun 17 11:07:23.585108 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 32ccdb21-38fc-43ce-babf-60a38df225e7 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:07:23.606461 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:23.690941 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 32ccdb21-38fc-43ce-babf-60a38df225e7 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:07:23.695137 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 32ccdb21-38fc-43ce-babf-60a38df225e7 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:07:23.695496 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:23.771251 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:23.792757 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32ccdb21-38fc-43ce-babf-60a38df225e7'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:07:23.795076 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e867f93e-52cb-4e5e-9d65-28f5901b722e" -d '{"events": [{"server_uuid": "cc31593d-01b6-4451-8ed4-dcacc7dd1852", "name": "network-vif-plugged", "status": "completed", "tag": "32ccdb21-38fc-43ce-babf-60a38df225e7"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:07:23.816753 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 32ccdb21-38fc-43ce-babf-60a38df225e7, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=32ccdb21-38fc-43ce-babf-60a38df225e7,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:07:23.831046 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:07:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18beb1f9-8dac-4a0e-8501-1c0e06d402c2 x-openstack-request-id: req-18beb1f9-8dac-4a0e-8501-1c0e06d402c2 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:07:23.831451 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cc31593d-01b6-4451-8ed4-dcacc7dd1852", "name": "network-vif-plugged", "status": "completed", "tag": "32ccdb21-38fc-43ce-babf-60a38df225e7", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:07:23.832336 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-18beb1f9-8dac-4a0e-8501-1c0e06d402c2 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:07:23.832528 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '32ccdb21-38fc-43ce-babf-60a38df225e7', 'code': 200} Jun 17 11:07:23.924975 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:23.926952 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-27faf0d1-2f05-464b-9cbc-af1562788a9f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:23.975049 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=32ccdb21-38fc-43ce-babf-60a38df225e7,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:23.978040 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:24.198760 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d90bdcd-76df-4594-8fbd-2bad17cfed6f req-b820c242-73a4-42dd-afa6-6159e2f85b76 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:24.200152 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4d90bdcd-76df-4594-8fbd-2bad17cfed6f req-b820c242-73a4-42dd-afa6-6159e2f85b76 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 945 time: 0.0662017 Jun 17 11:07:24.237315 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4d90bdcd-76df-4594-8fbd-2bad17cfed6f req-c3a5962d-04d0-47e9-ade4-0ecb112fd071 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314574 Jun 17 11:07:24.331849 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4db3eea-6fb5-4301-9fdd-e7d2ad0db26d req-8045102c-7747-4089-bf68-b216e861af84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:24.333270 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e4db3eea-6fb5-4301-9fdd-e7d2ad0db26d req-8045102c-7747-4089-bf68-b216e861af84 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 1098 time: 0.0500088 Jun 17 11:07:24.368178 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e4db3eea-6fb5-4301-9fdd-e7d2ad0db26d req-900e6783-35b7-4dc2-bfd5-bddbb69988be service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0271246 Jun 17 11:07:24.462312 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:24.580684 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7b9df88-1eae-49b4-adbb-9a818b9cece7 req-ae160755-e840-4e71-b3c3-07afc6aaada3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:24.582103 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e7b9df88-1eae-49b4-adbb-9a818b9cece7 req-ae160755-e840-4e71-b3c3-07afc6aaada3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0602343 Jun 17 11:07:24.618312 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e7b9df88-1eae-49b4-adbb-9a818b9cece7 req-fb536f96-77d9-4bc4-a4d6-b317511d7938 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306458 Jun 17 11:07:25.405767 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c57cb6c6-4203-4115-9091-241923e55c64 req-ab427612-5f3a-4593-9597-0554f3671ed6 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:25.407226 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c57cb6c6-4203-4115-9091-241923e55c64 req-ab427612-5f3a-4593-9597-0554f3671ed6 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 945 time: 0.0615551 Jun 17 11:07:25.443334 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c57cb6c6-4203-4115-9091-241923e55c64 req-613aaf81-343b-4a4a-ab7d-3fb501a96dc8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303149 Jun 17 11:07:25.798613 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b94a0c9-7093-4a43-a226-0c84c9989483 req-2994c9b0-dcfe-414d-9988-923617828c3f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:25.800127 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3b94a0c9-7093-4a43-a226-0c84c9989483 req-2994c9b0-dcfe-414d-9988-923617828c3f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0686569 Jun 17 11:07:25.840796 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3b94a0c9-7093-4a43-a226-0c84c9989483 req-7ee8a83b-fd03-4019-a5de-9abbf697085a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0344017 Jun 17 11:07:26.615104 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61df92fb-6786-4881-a0f5-8f788fa3df79 req-39f9933a-cf92-469e-a9ba-5cdbb353fae5 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:26.616577 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-61df92fb-6786-4881-a0f5-8f788fa3df79 req-39f9933a-cf92-469e-a9ba-5cdbb353fae5 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 945 time: 0.0630233 Jun 17 11:07:26.658188 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-61df92fb-6786-4881-a0f5-8f788fa3df79 req-c94bacdc-cef6-4b3d-a0ee-52238fa6596d tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0360143 Jun 17 11:07:26.787971 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:26.833005 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c94f59-1e53-42a2-83f1-4cb1f6a9fb96 req-d376f032-9559-47b2-9ebd-6e40fb8b9a04 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:26.834503 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79c94f59-1e53-42a2-83f1-4cb1f6a9fb96 req-d376f032-9559-47b2-9ebd-6e40fb8b9a04 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 945 time: 0.0639069 Jun 17 11:07:26.871569 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79c94f59-1e53-42a2-83f1-4cb1f6a9fb96 req-829f4a86-7802-4a64-b80c-e715e9db71df tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312903 Jun 17 11:07:26.896942 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40144) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:07:27.025344 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8f0727b-decf-4235-8af4-63354c57d8e2 req-0ae9beba-588d-49f3-ae99-71ad4c219c5e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:27.027170 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f8f0727b-decf-4235-8af4-63354c57d8e2 req-0ae9beba-588d-49f3-ae99-71ad4c219c5e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0687525 Jun 17 11:07:27.074542 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f8f0727b-decf-4235-8af4-63354c57d8e2 req-e900fbad-0199-49c6-8748-9f5cfc4ba5dc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388536 Jun 17 11:07:27.114241 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f128149-da30-47f4-a2f8-66c77936b2d7 tempest-TestVolumeBootPattern-1850253723 tempest-TestVolumeBootPattern-1850253723-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:27.115764 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-8f128149-da30-47f4-a2f8-66c77936b2d7 tempest-TestVolumeBootPattern-1850253723 tempest-TestVolumeBootPattern-1850253723-project-admin] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 1093 time: 0.2178128 Jun 17 11:07:27.118673 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40148) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:07:27.123838 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'floatingip': {'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'port_id': '32ccdb21-38fc-43ce-babf-60a38df225e7', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address': '172.20.0.8'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:07:27.240067 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:27.336911 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:27.448504 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Allocated IP 172.27.3.92 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/db671183-dbc1-4efc-86f5-c3892b598ff7) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:07:27.546764 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:27.638223 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:27.640336 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:27.681581 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:07:27.684658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:07:27.690795 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:07:27.723610 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'Port': ['ID=db671183-dbc1-4efc-86f5-c3892b598ff7,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:27.734907 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:28.047459 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:28.190692 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:28.338373 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31a8c6b9-4d87-4089-9d46-87e8c3770690 req-89f89a87-7e13-4fcd-8340-3cc641ab547e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:28.339792 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-31a8c6b9-4d87-4089-9d46-87e8c3770690 req-89f89a87-7e13-4fcd-8340-3cc641ab547e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.1471479 Jun 17 11:07:28.401470 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-31a8c6b9-4d87-4089-9d46-87e8c3770690 req-a3ee13f8-d30a-4823-80c5-9a1311abb107 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0543814 Jun 17 11:07:28.419888 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:28.477886 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:28.479972 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-92373d0f-a125-4aab-af10-4e0a9863a1ea tempest-VolumesSnapshotTestJSON-889554063 tempest-VolumesSnapshotTestJSON-889554063-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:28.546989 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'Port': ['ID=db671183-dbc1-4efc-86f5-c3892b598ff7,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:28.550717 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:28.558484 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:28.655238 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.l3_db [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Floating IP 277ae957-e21c-497c-8ffe-d40d1c6418e5 associated. External IP: 172.27.3.92, port: 32ccdb21-38fc-43ce-babf-60a38df225e7. Jun 17 11:07:28.857551 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:07:28.964347 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:07:28.973852 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b8c888b-28c4-471a-a945-831979fc7abc None None] Sync routers for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:07:28.982779 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b8c888b-28c4-471a-a945-831979fc7abc None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:07:28.983431 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5b8c888b-28c4-471a-a945-831979fc7abc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:07:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:07:29.050956 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:29.088358 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-5b8c888b-28c4-471a-a945-831979fc7abc None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:07:29.102875 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.9697168 Jun 17 11:07:29.102875 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'tag': '32ccdb21-38fc-43ce-babf-60a38df225e7'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:07:29.102875 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08" -d '{"events": [{"name": "network-changed", "server_uuid": "cc31593d-01b6-4451-8ed4-dcacc7dd1852", "tag": "32ccdb21-38fc-43ce-babf-60a38df225e7"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:07:29.129184 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:07:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3de00be-8b12-46fe-a0ed-e483816f2315 x-openstack-request-id: req-f3de00be-8b12-46fe-a0ed-e483816f2315 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:07:29.129508 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cc31593d-01b6-4451-8ed4-dcacc7dd1852", "tag": "32ccdb21-38fc-43ce-babf-60a38df225e7", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:07:29.129794 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-f3de00be-8b12-46fe-a0ed-e483816f2315 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:07:29.130223 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'tag': '32ccdb21-38fc-43ce-babf-60a38df225e7', 'status': 'completed', 'code': 200} Jun 17 11:07:29.219906 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08 req-6d083f96-16f5-4daf-ace1-ce163496b84f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:29.221313 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08 req-6d083f96-16f5-4daf-ace1-ce163496b84f service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 1098 time: 0.0551231 Jun 17 11:07:29.312352 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08 req-2876a533-8fd7-41c3-8e38-7edc2ac85063 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:29.313808 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08 req-2876a533-8fd7-41c3-8e38-7edc2ac85063 service neutron] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 913 time: 0.0855813 Jun 17 11:07:29.315733 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5b8c888b-28c4-471a-a945-831979fc7abc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '277ae957-e21c-497c-8ffe-d40d1c6418e5', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.92', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '32ccdb21-38fc-43ce-babf-60a38df225e7', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:03:91:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:07:27Z', 'updated_at': '2021-06-17T11:07:27Z', 'revision_number': 0, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:07:29.349955 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b8c888b-28c4-471a-a945-831979fc7abc None None] Checking router: 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:07:29.362950 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b8c888b-28c4-471a-a945-831979fc7abc None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:07:29.363172 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5b8c888b-28c4-471a-a945-831979fc7abc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:07:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:07:29.392396 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08 req-30adee23-4e60-45c5-bc99-2c4f6360737c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=32ccdb21-38fc-43ce-babf-60a38df225e7 HTTP/1.1" status: 200 len: 998 time: 0.0711288 Jun 17 11:07:29.451529 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08 req-d6e3f178-2361-4921-9c75-27d372429fee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:29.453005 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08 req-d6e3f178-2361-4921-9c75-27d372429fee service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0509923 Jun 17 11:07:29.477099 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-5b8c888b-28c4-471a-a945-831979fc7abc None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:07:29.510436 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08 req-3d3519fd-968b-440f-8306-83ef06a75723 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:29.511970 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08 req-3d3519fd-968b-440f-8306-83ef06a75723 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0522964 Jun 17 11:07:29.644222 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08 req-a89782ab-72d3-4b85-b360-5fad53fff2a7 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1250050 Jun 17 11:07:29.652164 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f47eafc0-eb97-472c-ad93-9959d10e6932 req-acf901cb-b6e9-4e11-9963-27d37d61aa19 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:29.653655 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f47eafc0-eb97-472c-ad93-9959d10e6932 req-acf901cb-b6e9-4e11-9963-27d37d61aa19 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.1263542 Jun 17 11:07:29.712206 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5b8c888b-28c4-471a-a945-831979fc7abc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '277ae957-e21c-497c-8ffe-d40d1c6418e5', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.92', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '32ccdb21-38fc-43ce-babf-60a38df225e7', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:03:91:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:07:27Z', 'updated_at': '2021-06-17T11:07:27Z', 'revision_number': 0, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:07:29.743074 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b8c888b-28c4-471a-a945-831979fc7abc None None] The sync data for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi is: [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '277ae957-e21c-497c-8ffe-d40d1c6418e5', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.92', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '32ccdb21-38fc-43ce-babf-60a38df225e7', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:03:91:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:07:27Z', 'updated_at': '2021-06-17T11:07:27Z', 'revision_number': 0, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:07:29.750971 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f47eafc0-eb97-472c-ad93-9959d10e6932 req-901a00bf-b9c5-445b-a0ba-e18038d15703 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0889807 Jun 17 11:07:29.778799 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-88a6bab7-9cfd-48b2-b63a-27a927cb8d08 req-d5770c05-48cb-4d6a-85a2-7e50bd3207d6 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1241317 Jun 17 11:07:29.943987 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-049806c2-0c27-4672-bb4a-369141b57b5c None None] New status for floating IP 277ae957-e21c-497c-8ffe-d40d1c6418e5: ACTIVE {{(pid=110218) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:07:30.937829 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9679769-5a12-41b6-b815-9e6b5c88b825 req-c8065272-cb91-4d20-a255-6e2cc38d6161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:30.939384 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d9679769-5a12-41b6-b815-9e6b5c88b825 req-c8065272-cb91-4d20-a255-6e2cc38d6161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0641725 Jun 17 11:07:30.976700 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d9679769-5a12-41b6-b815-9e6b5c88b825 req-b113c054-54c6-4dc8-ac9a-e61ec9b600c0 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317185 Jun 17 11:07:32.155920 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6d651ca-8beb-479f-8d1f-15dfaa54625a req-75bc3840-2a3b-4deb-ab61-ac03649dc289 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:32.157400 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d6d651ca-8beb-479f-8d1f-15dfaa54625a req-75bc3840-2a3b-4deb-ab61-ac03649dc289 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0634794 Jun 17 11:07:32.195429 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d6d651ca-8beb-479f-8d1f-15dfaa54625a req-ab77dff4-5cb3-43be-9dcc-2f693600d3ee tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0323501 Jun 17 11:07:33.373662 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6023ef4d-0234-43fa-8dcc-36cbeebcd711 req-cd48a0fb-ae61-4e4a-9c7b-a3c6f3c4479b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:33.375961 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6023ef4d-0234-43fa-8dcc-36cbeebcd711 req-cd48a0fb-ae61-4e4a-9c7b-a3c6f3c4479b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0658898 Jun 17 11:07:33.412464 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6023ef4d-0234-43fa-8dcc-36cbeebcd711 req-b15913f0-7d05-4ee9-a29d-d73eefc42be2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307901 Jun 17 11:07:34.585421 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83d0ec37-3a85-4301-a968-32218ec3b3e3 req-cbebd4d8-edba-41b5-8c58-c7d9a95f71c2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:34.586868 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83d0ec37-3a85-4301-a968-32218ec3b3e3 req-cbebd4d8-edba-41b5-8c58-c7d9a95f71c2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0610001 Jun 17 11:07:34.627982 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83d0ec37-3a85-4301-a968-32218ec3b3e3 req-42a0e0e7-1007-4fe3-956e-374fb4e62247 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0356112 Jun 17 11:07:34.939710 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-77599b30-d121-4a47-b6fb-bdf5e6679614 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0499525 Jun 17 11:07:35.013186 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-ef770d52-6101-4815-87a9-fd58658d1458 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:35.014626 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-ef770d52-6101-4815-87a9-fd58658d1458 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ed69cf6aa40941c48c25effb0c1af8fc&device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 1138 time: 0.0506654 Jun 17 11:07:35.121374 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-1d0b9780-f04d-457d-8b51-077ba7a5147a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:35.122812 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-1d0b9780-f04d-457d-8b51-077ba7a5147a service neutron] 10.222.0.25 "GET /v2.0/networks?id=aeced3ed-7670-4043-a385-87de6f75150b HTTP/1.1" status: 200 len: 916 time: 0.0866511 Jun 17 11:07:35.188384 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-284090ff-946e-42cb-89b5-4594b3fbaa32 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 HTTP/1.1" status: 200 len: 1001 time: 0.0579884 Jun 17 11:07:35.236322 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-b91c694c-7e35-47d3-9e3c-3597dad5e607 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:35.237822 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-b91c694c-7e35-47d3-9e3c-3597dad5e607 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=5d332463-1c62-46e2-a7e3-4b587a2e5f1e HTTP/1.1" status: 200 len: 854 time: 0.0427468 Jun 17 11:07:35.303881 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-cc2aa984-bfe7-4b44-8cf4-71efdaf9befd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:35.305393 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-cc2aa984-bfe7-4b44-8cf4-71efdaf9befd service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=aeced3ed-7670-4043-a385-87de6f75150b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0580556 Jun 17 11:07:35.394792 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-2e46f9c8-f2a2-41a0-81ae-b936d6fe8e5d service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809901 Jun 17 11:07:35.483853 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-40c6ac25-e9bb-416d-a9a3-54ea2c183dee req-055d0f61-2064-4a68-b31e-852322dae46c service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823011 Jun 17 11:07:35.807545 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6656941a-cc92-4f8d-9f58-bca076493bf8 req-9fb45a5a-b977-47cc-affa-80d986222f75 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:35.811531 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6656941a-cc92-4f8d-9f58-bca076493bf8 req-9fb45a5a-b977-47cc-affa-80d986222f75 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0648446 Jun 17 11:07:35.847308 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6656941a-cc92-4f8d-9f58-bca076493bf8 req-d80b56a7-af67-4a4a-b1ec-f95f3ccd00a4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0326760 Jun 17 11:07:37.028766 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-042d543a-9d2a-4b49-bc1f-9f492359e9a5 req-348467ee-7688-4796-9bfb-fff2b5b80c3f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:37.030120 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-042d543a-9d2a-4b49-bc1f-9f492359e9a5 req-348467ee-7688-4796-9bfb-fff2b5b80c3f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0616727 Jun 17 11:07:37.067520 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-042d543a-9d2a-4b49-bc1f-9f492359e9a5 req-ae640f71-6dc7-4a98-8987-db9a93bf58cc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312471 Jun 17 11:07:37.673859 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:37.678191 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 787f2fec-2d83-44f5-9283-874e16102ce0 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:07:37.769864 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:07:37.780947 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '787f2fec-2d83-44f5-9283-874e16102ce0', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'port_id': '787f2fec-2d83-44f5-9283-874e16102ce0', 'mac_address': 'fa:16:3e:d7:aa:86', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:07:37.821246 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:37.953627 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 787f2fec-2d83-44f5-9283-874e16102ce0 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:07:37.972860 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:07:38.062180 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:38.063963 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:38.110491 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=787f2fec-2d83-44f5-9283-874e16102ce0,revision_number=6']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:38.117479 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.117838 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.118165 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.118497 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.118890 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.119177 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.119503 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.119826 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.120190 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.120458 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.120779 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.121097 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:38.125032 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:38.232845 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['787f2fec-2d83-44f5-9283-874e16102ce0'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:07:38.244675 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61bd0eae-2472-4182-982b-6537b142e777 req-5f636bff-63e8-43fa-8fd5-3fcd895ee5e2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:38.246646 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-61bd0eae-2472-4182-982b-6537b142e777 req-5f636bff-63e8-43fa-8fd5-3fcd895ee5e2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 944 time: 0.0626144 Jun 17 11:07:38.288561 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-61bd0eae-2472-4182-982b-6537b142e777 req-d8218148-d40d-49a8-8f1c-9d5f5de9b3cd tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0363734 Jun 17 11:07:39.461056 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a01f27e-9b1f-41ba-9130-0fa6132d0295 req-c8e33666-1044-47ec-8ff2-cdf543a59cc2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:39.462412 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3a01f27e-9b1f-41ba-9130-0fa6132d0295 req-c8e33666-1044-47ec-8ff2-cdf543a59cc2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 944 time: 0.0623419 Jun 17 11:07:39.502894 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3a01f27e-9b1f-41ba-9130-0fa6132d0295 req-cd73797a-ddc9-47c0-acbb-90685cec5237 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0349102 Jun 17 11:07:39.683427 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 787f2fec-2d83-44f5-9283-874e16102ce0 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:07:39.730392 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 787f2fec-2d83-44f5-9283-874e16102ce0 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:07:39.730680 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:39.803076 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:39.825274 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:07:39.827599 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9232319a-4dc1-434d-942d-c576dc26137e" -d '{"events": [{"server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "name": "network-vif-plugged", "status": "completed", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:07:39.840227 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:07:39.864517 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:07:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5541b2c2-601f-49d8-9219-775ef3179f87 x-openstack-request-id: req-5541b2c2-601f-49d8-9219-775ef3179f87 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:07:39.864881 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "name": "network-vif-plugged", "status": "completed", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:07:39.865190 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-5541b2c2-601f-49d8-9219-775ef3179f87 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:07:39.865698 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0', 'code': 200} Jun 17 11:07:39.900696 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:39.903549 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:39.961307 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=787f2fec-2d83-44f5-9283-874e16102ce0,revision_number=7']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:39.964379 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:40.680347 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-447da7b8-0a91-4b23-b1e3-9c7bd5753a05 req-0d629134-0954-4eb4-af7b-075c14b3175f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:40.681734 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-447da7b8-0a91-4b23-b1e3-9c7bd5753a05 req-0d629134-0954-4eb4-af7b-075c14b3175f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0648630 Jun 17 11:07:40.719776 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-447da7b8-0a91-4b23-b1e3-9c7bd5753a05 req-de40c439-5d12-4938-8819-0568ae872d88 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0323863 Jun 17 11:07:41.898117 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c570356f-2675-4f06-bb41-8e45a19ae62d req-7dd6d11f-edcd-404a-84e6-b1367a304a2f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:41.899613 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c570356f-2675-4f06-bb41-8e45a19ae62d req-7dd6d11f-edcd-404a-84e6-b1367a304a2f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0644243 Jun 17 11:07:41.938681 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c570356f-2675-4f06-bb41-8e45a19ae62d req-07c84488-4ab1-4efe-a97c-0d05dd078847 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0331204 Jun 17 11:07:43.119185 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ce8079-d660-4caa-a91f-80d17e1d45aa req-1c62a776-35a6-44a9-9f8d-6cf61e1f16a2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:43.120627 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b0ce8079-d660-4caa-a91f-80d17e1d45aa req-1c62a776-35a6-44a9-9f8d-6cf61e1f16a2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0637283 Jun 17 11:07:43.157968 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b0ce8079-d660-4caa-a91f-80d17e1d45aa req-2b3ab01c-a0a5-40a9-bdbc-52aeae35c5eb tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314865 Jun 17 11:07:44.008188 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f2903ef-59b6-43dd-a6a9-7cac35878182 req-d3356127-ca1d-4dd4-adc1-a5f71565833e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:44.010018 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9f2903ef-59b6-43dd-a6a9-7cac35878182 req-d3356127-ca1d-4dd4-adc1-a5f71565833e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.3282011 Jun 17 11:07:44.048579 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9f2903ef-59b6-43dd-a6a9-7cac35878182 req-347bc2d1-1bc4-4ac2-80c8-0726274478d6 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0315974 Jun 17 11:07:44.353766 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4440662-800a-4786-bb04-098a37d1a938 req-d079c23c-2831-466e-be3a-8d17185130fc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:44.356004 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e4440662-800a-4786-bb04-098a37d1a938 req-d079c23c-2831-466e-be3a-8d17185130fc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0680380 Jun 17 11:07:44.404939 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e4440662-800a-4786-bb04-098a37d1a938 req-68d260d6-f9c4-4d13-b679-4d63076e7df0 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426676 Jun 17 11:07:45.257403 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf7ebf67-6028-44f1-ad1c-44df545a4732 req-9f7259b9-fa53-4e72-806d-8309303ecfbb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:45.269294 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cf7ebf67-6028-44f1-ad1c-44df545a4732 req-9f7259b9-fa53-4e72-806d-8309303ecfbb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0956659 Jun 17 11:07:45.321080 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cf7ebf67-6028-44f1-ad1c-44df545a4732 req-b77467ff-ab60-4c19-8d45-9d6470f414ab tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493531 Jun 17 11:07:45.479742 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-4fc5f1cc-8164-4123-8c75-a18135dcfc6c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:45.481541 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-4fc5f1cc-8164-4123-8c75-a18135dcfc6c tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.25 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0802293 Jun 17 11:07:45.622195 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Deleting port 584d5dfc-3f46-4820-80b2-e729ce075654 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:07:45.622195 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:45.635096 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7f1de0-f681-4656-b184-49a94a255a30 req-07ac29cb-92d4-447d-9352-c1bb5aeb3e85 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:45.636883 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0a7f1de0-f681-4656-b184-49a94a255a30 req-07ac29cb-92d4-447d-9352-c1bb5aeb3e85 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0869002 Jun 17 11:07:45.714494 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0a7f1de0-f681-4656-b184-49a94a255a30 req-56feef09-fdfa-4616-b2cb-063d3f5627db tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0706697 Jun 17 11:07:45.737047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] For port 584d5dfc-3f46-4820-80b2-e729ce075654, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=584d5dfc-3f46-4820-80b2-e729ce075654,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:07:45.737429 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:46.060235 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:46.061090 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:46.063653 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.l3_db [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Floating IP a57b1ca8-3f63-4809-bc21-3fe5eddb3498 disassociated. External IP: 172.27.3.86, port: 584d5dfc-3f46-4820-80b2-e729ce075654. Jun 17 11:07:46.063653 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Calling delete_port for 584d5dfc-3f46-4820-80b2-e729ce075654 owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:07:46.515089 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f5f631-2109-4aa0-bc4c-ab386a9b4af6 req-0e5565ad-d5ea-4698-8b5f-783f715b1ec0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:46.516487 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9f5f631-2109-4aa0-bc4c-ab386a9b4af6 req-0e5565ad-d5ea-4698-8b5f-783f715b1ec0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 945 time: 0.0750253 Jun 17 11:07:46.562979 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:46.569916 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:46.575815 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e9f5f631-2109-4aa0-bc4c-ab386a9b4af6 req-94f2d9c4-0518-4ae4-9c96-d9b2eb280ea5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=b02c5682-d2cc-40d2-81a5-81d43f06e80d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0532427 Jun 17 11:07:46.611966 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event deleted for resources: {'Port': ['ID=584d5dfc-3f46-4820-80b2-e729ce075654,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:46.617481 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:46.777344 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Router a17f3ab0-fe2c-4834-806d-28b3794b6366 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:07:46.928390 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:07:46.941044 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-228e2a9a-725e-4cb6-8da2-8b1d69d80c2a None None] Sync routers for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:07:46.957959 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-228e2a9a-725e-4cb6-8da2-8b1d69d80c2a None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:07:46.959456 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-228e2a9a-725e-4cb6-8da2-8b1d69d80c2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:07:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:07:47.001756 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] No DVR routers for this DVR port 584d5dfc-3f46-4820-80b2-e729ce075654 on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:07:47.006451 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:47.009537 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-eec6313d-270f-46f4-99a8-bf6f5e0d35d5 req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.25 "DELETE /v2.0/ports/584d5dfc-3f46-4820-80b2-e729ce075654 HTTP/1.1" status: 204 len: 173 time: 1.5173423 Jun 17 11:07:47.010078 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0878d13b-20f2-49ea-8fe7-94094628f250', 'name': 'network-vif-deleted', 'tag': '584d5dfc-3f46-4820-80b2-e729ce075654'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:07:47.012709 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8118cea-82fc-4a61-a60e-38ef1c1b9cb7" -d '{"events": [{"server_uuid": "0878d13b-20f2-49ea-8fe7-94094628f250", "name": "network-vif-deleted", "tag": "584d5dfc-3f46-4820-80b2-e729ce075654"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:07:47.020137 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52b8bb58-26a4-4848-8a65-934eefb25152 req-58c5f91c-6de0-4cfc-b67a-22105885393a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:47.029600 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-52b8bb58-26a4-4848-8a65-934eefb25152 req-58c5f91c-6de0-4cfc-b67a-22105885393a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.1426535 Jun 17 11:07:47.096410 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-52b8bb58-26a4-4848-8a65-934eefb25152 req-3b543ab9-c724-4f55-ad7a-7e264e14b328 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0655444 Jun 17 11:07:47.119333 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:07:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b3708b21-c96c-4ac9-a259-7a9b3a540075 x-openstack-request-id: req-b3708b21-c96c-4ac9-a259-7a9b3a540075 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:07:47.119333 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0878d13b-20f2-49ea-8fe7-94094628f250", "name": "network-vif-deleted", "tag": "584d5dfc-3f46-4820-80b2-e729ce075654", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:07:47.119333 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-b3708b21-c96c-4ac9-a259-7a9b3a540075 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:07:47.119333 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0878d13b-20f2-49ea-8fe7-94094628f250', 'name': 'network-vif-deleted', 'tag': '584d5dfc-3f46-4820-80b2-e729ce075654', 'status': 'completed', 'code': 200} Jun 17 11:07:47.224857 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-228e2a9a-725e-4cb6-8da2-8b1d69d80c2a None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:07:47.548065 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-228e2a9a-725e-4cb6-8da2-8b1d69d80c2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:07:47.563003 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-228e2a9a-725e-4cb6-8da2-8b1d69d80c2a None None] Checking router: a17f3ab0-fe2c-4834-806d-28b3794b6366 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:07:47.572090 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-228e2a9a-725e-4cb6-8da2-8b1d69d80c2a None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:07:47.572709 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-228e2a9a-725e-4cb6-8da2-8b1d69d80c2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:07:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:07:47.692135 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-228e2a9a-725e-4cb6-8da2-8b1d69d80c2a None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:07:47.748321 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-25c3a0b1-5e6c-4542-a471-39425cc1b608 req-dc11cfcb-6223-4e1a-aecf-a1c70dccc6e5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 210 time: 0.0310388 Jun 17 11:07:47.908607 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-228e2a9a-725e-4cb6-8da2-8b1d69d80c2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:07:47.935283 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-228e2a9a-725e-4cb6-8da2-8b1d69d80c2a None None] The sync data for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi is: [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:07:48.049194 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:07:48.249020 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87c28938-9bb1-4f80-989c-d8c77177bd3f None None] New status for floating IP a57b1ca8-3f63-4809-bc21-3fe5eddb3498: DOWN {{(pid=110218) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:07:48.345597 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26f04da4-8932-410d-8c46-84745a2414ac req-7b0c4349-0ef0-4ce3-a945-618b269c70f3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:48.356421 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-26f04da4-8932-410d-8c46-84745a2414ac req-7b0c4349-0ef0-4ce3-a945-618b269c70f3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.1027544 Jun 17 11:07:48.396872 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-26f04da4-8932-410d-8c46-84745a2414ac req-ba02773a-15ce-49b6-8f9b-f1e0ceb0a0f5 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395682 Jun 17 11:07:48.952441 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-87fca024-8355-4854-ab04-014ce5669513 req-9c189c33-b981-4649-ac52-a1ad6b42fb74 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=0878d13b-20f2-49ea-8fe7-94094628f250 HTTP/1.1" status: 200 len: 210 time: 0.0386844 Jun 17 11:07:49.612397 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f573111c-b245-4d8c-99d1-5f57ce1cfd37 req-8e8c5328-d4cf-4540-816d-6742cd203bdd tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:49.614033 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f573111c-b245-4d8c-99d1-5f57ce1cfd37 req-8e8c5328-d4cf-4540-816d-6742cd203bdd tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0728471 Jun 17 11:07:49.653065 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f573111c-b245-4d8c-99d1-5f57ce1cfd37 req-fc209ae4-3eb9-4a3c-aee6-7a94b240fd4c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0334301 Jun 17 11:07:49.706366 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 584d5dfc-3f46-4820-80b2-e729ce075654 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:07:49.729546 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 584d5dfc-3f46-4820-80b2-e729ce075654 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:07:49.729990 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 584d5dfc-3f46-4820-80b2-e729ce075654 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:07:50.160147 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 40268) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:07:50.217318 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:50.242298 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:50.433597 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:50.437296 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:50.438463 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "DELETE /v2.0/security-groups/b02c5682-d2cc-40d2-81a5-81d43f06e80d HTTP/1.1" status: 204 len: 168 time: 0.2773108 Jun 17 11:07:50.439394 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-fe37cbbc-c525-4685-ba95-f4e25adb968a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:50.441378 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40270) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:07:50.449998 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b02c5682-d2cc-40d2-81a5-81d43f06e80d,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:50.458080 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.458484 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.458924 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.459052 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.api.v2.resource [None req-139ffe69-20ae-4561-b0b4-cbf103aabdc9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] show failed (client error): The resource could not be found. Jun 17 11:07:50.459293 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.463133 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.463288 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-139ffe69-20ae-4561-b0b4-cbf103aabdc9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups/b02c5682-d2cc-40d2-81a5-81d43f06e80d HTTP/1.1" status: 404 len: 347 time: 0.0176351 Jun 17 11:07:50.463394 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.463394 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.463394 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.463394 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.463394 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.463394 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.463394 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:07:50.463911 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40272) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:07:50.466548 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-ea62c591-8135-4e82-bbbc-8ab44613944a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:50.593623 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Deleting port 72b90c9a-f7fd-4fb7-b295-89a14b662c32 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:07:50.593853 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:50.644839 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a235ec8f-14d2-4be3-85f9-4deff34b37a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:50.671455 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:50.671812 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:50.742284 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Calling delete_port for 72b90c9a-f7fd-4fb7-b295-89a14b662c32 owned by network:floatingip {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:07:50.956846 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d81c39-794e-49d9-8f26-477af4b2596e req-15b6765d-d385-4b87-bee9-35296e97e359 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:50.958254 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b9d81c39-794e-49d9-8f26-477af4b2596e req-15b6765d-d385-4b87-bee9-35296e97e359 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.1720159 Jun 17 11:07:51.002007 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b9d81c39-794e-49d9-8f26-477af4b2596e req-37a65488-ac9d-4fa2-91c0-a7320e90841f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376680 Jun 17 11:07:51.027967 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:51.031259 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-2eb99502-2b3e-4068-8ccc-2025920617f7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:51.055917 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event deleted for resources: {'Port': ['ID=72b90c9a-f7fd-4fb7-b295-89a14b662c32,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:51.059727 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:51.129633 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:51.134512 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:51.134512 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "DELETE /v2.0/floatingips/a57b1ca8-3f63-4809-bc21-3fe5eddb3498 HTTP/1.1" status: 204 len: 168 time: 0.6691208 Jun 17 11:07:51.533359 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40278) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:07:51.538141 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-906dc87b-5317-4817-a6af-b9164903c150 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1905950635', 'description': 'tempest-description--916002699'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:07:51.639801 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-906dc87b-5317-4817-a6af-b9164903c150 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:51.735887 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-906dc87b-5317-4817-a6af-b9164903c150 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:51.824938 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-906dc87b-5317-4817-a6af-b9164903c150 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:51.828226 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-52874f9a-3b7d-4404-89df-e56a6f164917 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:51.862763 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-906dc87b-5317-4817-a6af-b9164903c150 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'SecurityGroup': ['ID=47d46c40-fb66-47dc-8e4e-ffc58b584d3e,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:51.866019 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-906dc87b-5317-4817-a6af-b9164903c150 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:52.197848 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28171d0e-b66c-48c1-aef7-04f68e0103a5 req-3719a8cf-3f05-48db-933c-cd425b430868 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:52.199332 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-28171d0e-b66c-48c1-aef7-04f68e0103a5 req-3719a8cf-3f05-48db-933c-cd425b430868 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0683022 Jun 17 11:07:52.238674 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-28171d0e-b66c-48c1-aef7-04f68e0103a5 req-74cf5f96-16bf-4c54-bab3-49b9feadfab2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0336821 Jun 17 11:07:52.569748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-906dc87b-5317-4817-a6af-b9164903c150 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:52.570910 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-906dc87b-5317-4817-a6af-b9164903c150 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 1.0365341 Jun 17 11:07:52.573662 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40282) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:07:52.578156 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-4864e98c-5b15-43ab-b304-e5b87f8de688 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'security_group_rule': {'security_group_id': '47d46c40-fb66-47dc-8e4e-ffc58b584d3e', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:07:52.702421 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4864e98c-5b15-43ab-b304-e5b87f8de688 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:52.767730 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4864e98c-5b15-43ab-b304-e5b87f8de688 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:52.870363 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4864e98c-5b15-43ab-b304-e5b87f8de688 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:52.873032 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cb552a5d-fd1d-4859-af0f-38b45065a31d tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:52.896533 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4864e98c-5b15-43ab-b304-e5b87f8de688 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a39c0907-dcc1-4ce5-a5e0-3808c81ed878,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:52.899225 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4864e98c-5b15-43ab-b304-e5b87f8de688 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:53.003670 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4864e98c-5b15-43ab-b304-e5b87f8de688 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:53.004995 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-4864e98c-5b15-43ab-b304-e5b87f8de688 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4303215 Jun 17 11:07:53.007902 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40288) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:07:53.013448 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-2a15c969-6922-4990-9217-8a1ded4a49e5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'security_group_rule': {'security_group_id': '47d46c40-fb66-47dc-8e4e-ffc58b584d3e', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:07:53.117682 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2a15c969-6922-4990-9217-8a1ded4a49e5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:53.187290 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2a15c969-6922-4990-9217-8a1ded4a49e5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:53.313816 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2a15c969-6922-4990-9217-8a1ded4a49e5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:53.323297 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:53.333117 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a15c969-6922-4990-9217-8a1ded4a49e5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e3c180e5-426f-46f8-9847-60c209f04f84,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:53.336199 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-2a15c969-6922-4990-9217-8a1ded4a49e5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:53.405370 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d3445886-c6e2-49b3-82d1-4bb7060c30e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:53.435793 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de30110e-89dd-417d-880c-0a3f7af22054 req-3ba58947-fd29-44f7-8321-20f015467b6c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:53.437273 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-de30110e-89dd-417d-880c-0a3f7af22054 req-3ba58947-fd29-44f7-8321-20f015467b6c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0781064 Jun 17 11:07:53.479543 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-de30110e-89dd-417d-880c-0a3f7af22054 req-880f323c-80be-496b-b237-b336c3113879 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359290 Jun 17 11:07:53.502200 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2a15c969-6922-4990-9217-8a1ded4a49e5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:53.502200 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-2a15c969-6922-4990-9217-8a1ded4a49e5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4905350 Jun 17 11:07:53.502786 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40292) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:07:53.507681 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'floatingip': {'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:07:53.605237 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:53.639813 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:53.774564 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:53.894543 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Allocated IP 172.27.3.158 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/d6400ff8-ec69-4cfa-8c76-5383c42c39be) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:07:54.014122 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:54.120216 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:54.122349 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9148f535-bb91-4642-bafd-d80ea0377577 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:54.160462 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:07:54.163366 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:07:54.169800 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:07:54.192339 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'Port': ['ID=d6400ff8-ec69-4cfa-8c76-5383c42c39be,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:54.196585 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:54.267239 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:54.408942 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:54.485182 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:54.592865 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:54.683987 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad04a024-f088-4f47-b664-8b72a46fb08b req-865ac188-2a39-40a5-ad1b-c15401fac5ae tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:54.685436 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ad04a024-f088-4f47-b664-8b72a46fb08b req-865ac188-2a39-40a5-ad1b-c15401fac5ae tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0780323 Jun 17 11:07:54.690985 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:54.695343 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-96c6b627-e4a0-4610-bfea-5202ba965b0e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:07:54.787794 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'Port': ['ID=d6400ff8-ec69-4cfa-8c76-5383c42c39be,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:07:54.793052 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ad04a024-f088-4f47-b664-8b72a46fb08b req-49e859f3-c988-4ca5-b00f-175500f2bab4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0986164 Jun 17 11:07:54.795759 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:07:54.804816 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:54.874075 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:54.875390 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.3715484 Jun 17 11:07:55.102270 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-356a6ccb-5570-4d55-8aac-cb980ac45974 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?name=tempest-securitygroup--1905950635&fields=id&tenant_id=f15e97a8adc74580bf4df14ed664fc3f HTTP/1.1" status: 200 len: 267 time: 0.0357571 Jun 17 11:07:55.220877 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-c2884595-b185-40e1-9d25-776dfc2f8fde tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:55.222474 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-c2884595-b185-40e1-9d25-776dfc2f8fde tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 810 time: 0.1130807 Jun 17 11:07:55.244327 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-012b2da5-5a69-4104-a423-0055294691a1 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/quotas/f15e97a8adc74580bf4df14ed664fc3f HTTP/1.1" status: 200 len: 375 time: 0.0104420 Jun 17 11:07:55.315810 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-6f0fe007-14e5-483e-889f-cfc621f18abd tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0659082 Jun 17 11:07:55.418772 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-22916457-a812-45d0-8c7e-e44b843d136c service neutron] 10.222.0.41 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0883710 Jun 17 11:07:55.527576 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-7984850c-b49a-42d8-a022-4da299e2e1c1 service neutron] 10.222.0.41 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1003513 Jun 17 11:07:55.873920 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-703f8273-d6b2-4c71-9c9c-fff919c4a63e req-f45e6405-7edb-4ec8-a422-d47eefc9c465 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 210 time: 0.0445838 Jun 17 11:07:56.100854 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1190f1-7cff-41ee-b374-3f4839174c94 req-5e1af057-114a-47ff-94f7-2a5cca409976 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:56.100854 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-aa1190f1-7cff-41ee-b374-3f4839174c94 req-5e1af057-114a-47ff-94f7-2a5cca409976 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0913980 Jun 17 11:07:56.143694 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-aa1190f1-7cff-41ee-b374-3f4839174c94 req-d9dc5fe2-4160-4d28-b6af-fa273b3102fd tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457540 Jun 17 11:07:56.947829 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1f9b5a10-5f7a-4237-a34d-ac2412675c5a req-b57a2d7e-0f05-4fb4-9002-292a24f357ea tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 210 time: 0.0300214 Jun 17 11:07:56.954226 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:57.365235 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138159a0-27f4-4ed7-a78b-a2f3d833d5d7 req-cc402404-7d8d-40b5-b7ec-b3a19d5149d6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:57.371740 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-138159a0-27f4-4ed7-a78b-a2f3d833d5d7 req-cc402404-7d8d-40b5-b7ec-b3a19d5149d6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0869703 Jun 17 11:07:57.410969 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-138159a0-27f4-4ed7-a78b-a2f3d833d5d7 req-4db5441a-a80a-4550-9abf-34bf94366f1a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380170 Jun 17 11:07:58.092457 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d69244c1-6715-4df4-92f6-536e77cea99f req-8bea3bb4-cae8-46d2-8a51-fce8399df9f2 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 210 time: 0.0291686 Jun 17 11:07:58.589402 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb120468-0849-452f-a46b-2bbb122b4174 req-cfc6e41f-016a-4d75-88bb-2ac9ea47085b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:58.590789 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-cb120468-0849-452f-a46b-2bbb122b4174 req-cfc6e41f-016a-4d75-88bb-2ac9ea47085b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0640252 Jun 17 11:07:58.628570 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-cb120468-0849-452f-a46b-2bbb122b4174 req-c66202f1-3f43-4d06-b27b-3bb5d2969217 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320418 Jun 17 11:07:59.234125 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6361f1b7-fadd-4f7d-89f1-7b613cb66703 req-b0621071-a6a2-4e04-8af2-f5454e928d05 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 210 time: 0.0304470 Jun 17 11:07:59.361363 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-ad619db3-f791-494c-b61a-5d4fd61a6854 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:59.362783 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-ad619db3-f791-494c-b61a-5d4fd61a6854 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.25 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 810 time: 0.1018014 Jun 17 11:07:59.405760 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-0313c971-c9ca-4839-bf3a-117710b2934e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f15e97a8adc74580bf4df14ed664fc3f HTTP/1.1" status: 200 len: 380 time: 0.0329828 Jun 17 11:07:59.414167 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'port': {'device_id': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'admin_state_up': True, 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'security_groups': ['47d46c40-fb66-47dc-8e4e-ffc58b584d3e']}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:07:59.610510 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c55151-7b1c-4208-ab28-d32ce37bdb8a req-c62ae5f2-77d4-42ad-a6f1-cbc8e18a0253 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:59.612114 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b8c55151-7b1c-4208-ab28-d32ce37bdb8a req-c62ae5f2-77d4-42ad-a6f1-cbc8e18a0253 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 1098 time: 0.0523551 Jun 17 11:07:59.614450 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Made reservation on behalf of f15e97a8adc74580bf4df14ed664fc3f for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:07:59.617902 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:07:59.772141 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c55151-7b1c-4208-ab28-d32ce37bdb8a req-bbaac665-069d-414b-b662-674c1ae6dbb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:59.773582 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b8c55151-7b1c-4208-ab28-d32ce37bdb8a req-bbaac665-069d-414b-b662-674c1ae6dbb8 service neutron] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 918 time: 0.1457913 Jun 17 11:07:59.815287 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b12c91-1501-4c02-b4c0-abbaeeeb329a req-2c05278f-0881-4934-87e8-45790a301d25 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:59.816662 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-79b12c91-1501-4c02-b4c0-abbaeeeb329a req-2c05278f-0881-4934-87e8-45790a301d25 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0675695 Jun 17 11:07:59.855307 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-79b12c91-1501-4c02-b4c0-abbaeeeb329a req-a9c8dfef-57d3-48eb-86ef-4a1cb71e6b71 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322468 Jun 17 11:07:59.871535 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Allocated IP 172.20.0.12 (54973ccd-0b2b-4517-ad28-76a3128a2da3/b70c69a2-cf24-49e5-90dd-a210bd42e6bb/de252d43-b5e2-49ef-8e0c-6b09c062aff6) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:07:59.878456 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b8c55151-7b1c-4208-ab28-d32ce37bdb8a req-84a956b0-c29b-49e6-8f8c-68072a91bdec service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=787f2fec-2d83-44f5-9283-874e16102ce0 HTTP/1.1" status: 200 len: 1000 time: 0.0815809 Jun 17 11:07:59.964830 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c55151-7b1c-4208-ab28-d32ce37bdb8a req-9e68cca8-0688-4e53-bc74-1cbf26004990 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:07:59.966272 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b8c55151-7b1c-4208-ab28-d32ce37bdb8a req-9e68cca8-0688-4e53-bc74-1cbf26004990 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0760956 Jun 17 11:08:00.077701 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:00.093427 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c55151-7b1c-4208-ab28-d32ce37bdb8a req-61b8892e-04ae-4435-b52b-9a542799d309 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:00.095043 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b8c55151-7b1c-4208-ab28-d32ce37bdb8a req-61b8892e-04ae-4435-b52b-9a542799d309 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1200290 Jun 17 11:08:00.097541 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Transition to ACTIVE for port object de252d43-b5e2-49ef-8e0c-6b09c062aff6 will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:08:00.467017 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5ce50bc9-dd11-495a-8b6c-376b98f05144 req-4c424782-0413-4341-9fcc-32f3ec1e2ca6 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 210 time: 0.0389292 Jun 17 11:08:00.493548 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b8c55151-7b1c-4208-ab28-d32ce37bdb8a req-7a9329f7-ac87-4366-8037-127e6ac5e24e service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3805263 Jun 17 11:08:00.555295 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:00.561224 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-855eacf5-ca19-40b6-9e02-a5b7c1a16a0e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:00.622526 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b8c55151-7b1c-4208-ab28-d32ce37bdb8a req-d526f972-b11c-4586-b18f-dffe8a4e9074 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1325839 Jun 17 11:08:00.627904 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Network 54973ccd-0b2b-4517-ad28-76a3128a2da3 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:08:00.633933 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:08:00.633933 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event updated for resources: {'Port': ['ID=de252d43-b5e2-49ef-8e0c-6b09c062aff6,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:00.636711 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:08:00.645380 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:00.695400 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:00.695628 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:00.771698 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3611166 Jun 17 11:08:00.787169 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Request body: {'port': {'device_id': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:08:00.860062 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:00.959748 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-e994bbc6-2981-4392-9281-ef0db15e2a5a None None] Provisioning for port de252d43-b5e2-49ef-8e0c-6b09c062aff6 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:08:00.964025 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-e994bbc6-2981-4392-9281-ef0db15e2a5a None None] Provisioning complete for port de252d43-b5e2-49ef-8e0c-6b09c062aff6 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:08:00.966120 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-e994bbc6-2981-4392-9281-ef0db15e2a5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:01.000487 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-e994bbc6-2981-4392-9281-ef0db15e2a5a None None] Port de252d43-b5e2-49ef-8e0c-6b09c062aff6 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:08:01.064258 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c29ab7f-636e-4bfc-a662-030b4f30c88e req-0646db56-bf4a-4fe0-9239-3887f6e95c7e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:01.065926 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9c29ab7f-636e-4bfc-a662-030b4f30c88e req-0646db56-bf4a-4fe0-9239-3887f6e95c7e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0651808 Jun 17 11:08:01.103706 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-9c29ab7f-636e-4bfc-a662-030b4f30c88e req-97eb06c0-b84c-4411-a3ca-9adfc948d107 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313616 Jun 17 11:08:01.131206 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id de252d43-b5e2-49ef-8e0c-6b09c062aff6 {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:08:01.138757 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:01.150575 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Transition to ACTIVE for port object de252d43-b5e2-49ef-8e0c-6b09c062aff6 will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:08:01.233463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:01.235705 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:01.317419 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Pushing event updated for resources: {'Port': ['ID=de252d43-b5e2-49ef-8e0c-6b09c062aff6,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:01.320407 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:01.386605 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Attempting to bind port de252d43-b5e2-49ef-8e0c-6b09c062aff6 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:08:01.386876 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Attempting to bind port de252d43-b5e2-49ef-8e0c-6b09c062aff6 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:08:01.387233 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Attempting to bind port de252d43-b5e2-49ef-8e0c-6b09c062aff6 on network 54973ccd-0b2b-4517-ad28-76a3128a2da3 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:08:01.391936 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Port de252d43-b5e2-49ef-8e0c-6b09c062aff6 on network 54973ccd-0b2b-4517-ad28-76a3128a2da3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:08:01.392261 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Attempting to bind port de252d43-b5e2-49ef-8e0c-6b09c062aff6 on network 54973ccd-0b2b-4517-ad28-76a3128a2da3 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:08:01.397380 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 7, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:08:01.397721 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Checking segment: {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:08:01.398109 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Bound using segment: {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:08:01.398539 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Bound port: de252d43-b5e2-49ef-8e0c-6b09c062aff6, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0b3760d5-4271-497d-a20f-fec4d6ed355c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:08:01.398914 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:01.467144 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] For port de252d43-b5e2-49ef-8e0c-6b09c062aff6, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:08:01.470055 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] For port de252d43-b5e2-49ef-8e0c-6b09c062aff6, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=de252d43-b5e2-49ef-8e0c-6b09c062aff6,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:08:01.548344 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:01.550654 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9bd52b06-29ce-4dbf-a3f9-c45af6356ab1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:01.588724 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:01.588724 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:01.588724 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] 10.222.0.25 "PUT /v2.0/ports/de252d43-b5e2-49ef-8e0c-6b09c062aff6 HTTP/1.1" status: 200 len: 1094 time: 0.8073609 Jun 17 11:08:01.589295 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'tag': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:08:01.591637 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-082bf197-a1de-434f-8b62-fa16aebf9fe1" -d '{"events": [{"name": "network-changed", "server_uuid": "83aa8649-9e05-4730-8b11-e8ee2387d111", "tag": "de252d43-b5e2-49ef-8e0c-6b09c062aff6"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:08:01.641118 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Pushing event updated for resources: {'Port': ['ID=de252d43-b5e2-49ef-8e0c-6b09c062aff6,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:01.644998 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:01.685306 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710342e7-f78d-448d-aa48-0cc6bcca16e8 req-c68f3cc5-d053-4c09-b07d-df4ac2273acb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:01.687103 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-710342e7-f78d-448d-aa48-0cc6bcca16e8 req-c68f3cc5-d053-4c09-b07d-df4ac2273acb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 944 time: 0.0880458 Jun 17 11:08:01.772077 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-710342e7-f78d-448d-aa48-0cc6bcca16e8 req-780519fd-3515-40a4-9969-0165213e20d0 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0722399 Jun 17 11:08:01.808498 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-b0073616-686f-4bbd-bd36-42e8fda8a2e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:01.810261 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-b0073616-686f-4bbd-bd36-42e8fda8a2e6 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 1097 time: 0.0945387 Jun 17 11:08:01.811770 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:08:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac330dfc-b313-446b-90ba-590704f5181c x-openstack-request-id: req-ac330dfc-b313-446b-90ba-590704f5181c {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:08:01.812089 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "83aa8649-9e05-4730-8b11-e8ee2387d111", "tag": "de252d43-b5e2-49ef-8e0c-6b09c062aff6", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:08:01.812379 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-ac330dfc-b313-446b-90ba-590704f5181c {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:08:01.812800 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'tag': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6', 'status': 'completed', 'code': 200} Jun 17 11:08:01.854389 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-fecaf4ed-4bb0-4466-bab1-3eec4d852e0f service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=de252d43-b5e2-49ef-8e0c-6b09c062aff6 HTTP/1.1" status: 200 len: 217 time: 0.0341949 Jun 17 11:08:01.902174 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-0a948e89-13d3-47ab-931a-bd9b53585d62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:01.903495 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-0a948e89-13d3-47ab-931a-bd9b53585d62 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 200 len: 849 time: 0.0427930 Jun 17 11:08:01.965524 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-e836c760-ca10-4446-aed5-58335f4361a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:01.967085 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-e836c760-ca10-4446-aed5-58335f4361a2 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=54973ccd-0b2b-4517-ad28-76a3128a2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0550611 Jun 17 11:08:02.056857 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-86d7ad7b-e389-401f-9955-e16d46cd3540 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814083 Jun 17 11:08:02.154395 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-151976bb-cdf3-4586-a1ce-d7e1ef58da7b req-2105f560-7bb7-4e52-9fe1-a873f9fe792c service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883129 Jun 17 11:08:02.278341 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26f622e-d2b0-43e5-a2b0-9a78b541e1ae req-a3a8a01a-8791-4a6a-a9ef-8338d1d1615d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:02.279812 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d26f622e-d2b0-43e5-a2b0-9a78b541e1ae req-a3a8a01a-8791-4a6a-a9ef-8338d1d1615d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0625210 Jun 17 11:08:02.327004 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d26f622e-d2b0-43e5-a2b0-9a78b541e1ae req-9c430140-a932-483d-a3c0-470578c4dea8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414515 Jun 17 11:08:02.368014 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082bf197-a1de-434f-8b62-fa16aebf9fe1 req-e37b7ddc-e24d-4b45-93ff-f010fd3346a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:02.375191 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-082bf197-a1de-434f-8b62-fa16aebf9fe1 req-e37b7ddc-e24d-4b45-93ff-f010fd3346a2 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 1097 time: 0.0557170 Jun 17 11:08:02.461107 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082bf197-a1de-434f-8b62-fa16aebf9fe1 req-aa5feb59-d1d9-46fa-940d-016652b7988a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:02.463030 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-082bf197-a1de-434f-8b62-fa16aebf9fe1 req-aa5feb59-d1d9-46fa-940d-016652b7988a service neutron] 10.222.0.25 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 911 time: 0.0853605 Jun 17 11:08:02.501882 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-082bf197-a1de-434f-8b62-fa16aebf9fe1 req-10f5329e-d71c-4173-b99b-eaaa4594c67c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=de252d43-b5e2-49ef-8e0c-6b09c062aff6 HTTP/1.1" status: 200 len: 217 time: 0.0328250 Jun 17 11:08:02.552852 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082bf197-a1de-434f-8b62-fa16aebf9fe1 req-d150c4fc-8f7f-4ac8-8962-fa9d5814ad6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:02.554268 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-082bf197-a1de-434f-8b62-fa16aebf9fe1 req-d150c4fc-8f7f-4ac8-8962-fa9d5814ad6b service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 200 len: 849 time: 0.0464203 Jun 17 11:08:02.611688 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082bf197-a1de-434f-8b62-fa16aebf9fe1 req-651cc6b9-0cc6-480e-bbda-3b4df2abc2bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:02.613152 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-082bf197-a1de-434f-8b62-fa16aebf9fe1 req-651cc6b9-0cc6-480e-bbda-3b4df2abc2bc service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=54973ccd-0b2b-4517-ad28-76a3128a2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0506585 Jun 17 11:08:02.703374 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-082bf197-a1de-434f-8b62-fa16aebf9fe1 req-3d00fc5f-c78f-415b-9366-5b76c701a1fb service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824785 Jun 17 11:08:02.796513 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-082bf197-a1de-434f-8b62-fa16aebf9fe1 req-6445546e-718c-4893-99f3-c66202f4d8a2 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861752 Jun 17 11:08:02.956410 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-870f70a7-b010-40ef-bdd9-098bf1c69790 req-88bbb040-020a-4c91-97d1-9a3cd8ed9876 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:02.957904 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-870f70a7-b010-40ef-bdd9-098bf1c69790 req-88bbb040-020a-4c91-97d1-9a3cd8ed9876 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 944 time: 0.0635509 Jun 17 11:08:02.996170 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-870f70a7-b010-40ef-bdd9-098bf1c69790 req-44ca9e57-d43e-4da3-9454-35d6c02fe653 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318234 Jun 17 11:08:03.502554 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81b3afb-8c31-41c1-bb3b-8d6d0a1d639d req-c996da97-6191-4c4b-9469-8046cc46ada7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:03.504157 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c81b3afb-8c31-41c1-bb3b-8d6d0a1d639d req-c996da97-6191-4c4b-9469-8046cc46ada7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 945 time: 0.0633349 Jun 17 11:08:03.542636 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c81b3afb-8c31-41c1-bb3b-8d6d0a1d639d req-79c58b53-5d8f-46c9-b1f8-aca916b7e616 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322938 Jun 17 11:08:03.795646 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 787f2fec-2d83-44f5-9283-874e16102ce0 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:08:03.875801 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:03.903667 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:08:03.905997 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1683ac5-ccfd-477a-9c78-897e64ab06fe" -d '{"events": [{"server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "name": "network-vif-unplugged", "status": "completed", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:08:03.919661 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:03.939449 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 17 Jun 2021 11:08:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd062ef7-6476-4015-b6da-763080f900c4 x-openstack-request-id: req-cd062ef7-6476-4015-b6da-763080f900c4 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:08:03.939928 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "name": "network-vif-unplugged", "status": "failed", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0", "code": 422}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:08:03.940355 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-cd062ef7-6476-4015-b6da-763080f900c4 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:08:03.941057 dv-cinder-773870-6-iscsi neutron-server[110216]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0', 'code': 422} returned with failed status Jun 17 11:08:04.011313 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:04.013162 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-fba0e838-69c7-4166-8f34-f6655851145c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:04.061513 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=787f2fec-2d83-44f5-9283-874e16102ce0,revision_number=8']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:04.064888 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:04.189503 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c1923d-e24e-4ef2-ab2e-06977ddc32c0 req-25f9a52f-f4f5-4d1c-9f3c-6e7270e2b9a5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:04.191098 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-57c1923d-e24e-4ef2-ab2e-06977ddc32c0 req-25f9a52f-f4f5-4d1c-9f3c-6e7270e2b9a5 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 944 time: 0.0753710 Jun 17 11:08:04.232493 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-57c1923d-e24e-4ef2-ab2e-06977ddc32c0 req-3b3223f2-eef5-4495-9549-9131d12d293b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0357394 Jun 17 11:08:05.410710 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87404727-f723-4078-b424-75ed0aecc0fd req-0c73bcd9-7e29-4a7a-a7d1-e3c10403de9b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:05.412189 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-87404727-f723-4078-b424-75ed0aecc0fd req-0c73bcd9-7e29-4a7a-a7d1-e3c10403de9b tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 944 time: 0.0668302 Jun 17 11:08:05.455482 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-87404727-f723-4078-b424-75ed0aecc0fd req-3398f279-183c-4853-9e52-2b612a2295d8 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0367777 Jun 17 11:08:05.471505 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc33ff5-715f-4f8e-ad41-9a9d3001def8 req-46436464-d78f-442b-a541-af1d668c104f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:05.473264 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7bc33ff5-715f-4f8e-ad41-9a9d3001def8 req-46436464-d78f-442b-a541-af1d668c104f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0708230 Jun 17 11:08:05.512577 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7bc33ff5-715f-4f8e-ad41-9a9d3001def8 req-5d528ef2-5700-4e2b-8ba5-2cdad50505bb tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321174 Jun 17 11:08:05.799378 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device de252d43-b5e2-49ef-8e0c-6b09c062aff6 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:08:05.896156 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port de252d43-b5e2-49ef-8e0c-6b09c062aff6, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=de252d43-b5e2-49ef-8e0c-6b09c062aff6,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:05.912524 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'port_id': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6', 'mac_address': 'fa:16:3e:2b:cf:52', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 126, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:08:05.927204 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40410) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:05.958333 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:05.972470 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id de252d43-b5e2-49ef-8e0c-6b09c062aff6 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:08:05.992273 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port de252d43-b5e2-49ef-8e0c-6b09c062aff6, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=de252d43-b5e2-49ef-8e0c-6b09c062aff6,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:06.019466 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-901cbe01-58ba-41e0-adcc-0eb0541bf396 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0909774 Jun 17 11:08:06.097655 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:06.100456 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-418074a1-98ea-4a0d-a119-4c50050b8e78 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:06.147896 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=de252d43-b5e2-49ef-8e0c-6b09c062aff6,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:06.151457 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:06.500552 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['de252d43-b5e2-49ef-8e0c-6b09c062aff6'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:08:06.636027 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f49a702-bb84-40c3-b0ab-36faad5f3c8b req-e831d20b-788a-4a6b-bc46-7279515f5703 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:06.637576 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3f49a702-bb84-40c3-b0ab-36faad5f3c8b req-e831d20b-788a-4a6b-bc46-7279515f5703 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 945 time: 0.0707223 Jun 17 11:08:06.677364 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3f49a702-bb84-40c3-b0ab-36faad5f3c8b req-053d1ee6-8af2-48fd-b8e2-ed5a69531c43 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0341077 Jun 17 11:08:06.733164 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7849c21f-2e99-4db8-86c9-8bed6f8e921c req-688cc84b-b8a4-4551-bfbd-d8cfa316e111 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:06.734721 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7849c21f-2e99-4db8-86c9-8bed6f8e921c req-688cc84b-b8a4-4551-bfbd-d8cfa316e111 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0960927 Jun 17 11:08:06.777484 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7849c21f-2e99-4db8-86c9-8bed6f8e921c req-f37252dc-2f25-4601-a3cd-3a81db7e8219 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0368538 Jun 17 11:08:07.707508 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:07.811658 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device de252d43-b5e2-49ef-8e0c-6b09c062aff6 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:08:07.866238 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dff86b9-cd67-42a3-b02e-b51a9f9b9c78 req-de551bf3-7f1b-4f09-a335-7914d3a4ca2a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:07.872565 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7dff86b9-cd67-42a3-b02e-b51a9f9b9c78 req-de551bf3-7f1b-4f09-a335-7914d3a4ca2a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 945 time: 0.0726695 Jun 17 11:08:07.909314 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7dff86b9-cd67-42a3-b02e-b51a9f9b9c78 req-21c8c567-552c-4933-a63b-3306a66f9488 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0333259 Jun 17 11:08:07.947864 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port de252d43-b5e2-49ef-8e0c-6b09c062aff6 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:08:07.952312 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port de252d43-b5e2-49ef-8e0c-6b09c062aff6 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:08:07.952912 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:07.965747 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b1f89e-182b-4a4b-a99d-2d605b42a27d req-dcefe114-6604-4920-a64b-e3ad9e5459c6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:07.967261 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-59b1f89e-182b-4a4b-a99d-2d605b42a27d req-dcefe114-6604-4920-a64b-e3ad9e5459c6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0677376 Jun 17 11:08:08.005080 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-59b1f89e-182b-4a4b-a99d-2d605b42a27d req-25546b19-02cb-4fb8-986a-e3f8d46134a5 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320125 Jun 17 11:08:08.037544 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:08.060161 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:08:08.062438 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd7b4136-bcda-4059-924c-a2a9bbfa1934" -d '{"events": [{"server_uuid": "83aa8649-9e05-4730-8b11-e8ee2387d111", "name": "network-vif-plugged", "status": "completed", "tag": "de252d43-b5e2-49ef-8e0c-6b09c062aff6"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:08:08.075479 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port de252d43-b5e2-49ef-8e0c-6b09c062aff6, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=de252d43-b5e2-49ef-8e0c-6b09c062aff6,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:08.106005 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:08:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f469cc87-9db4-4949-8ede-4d9de2604030 x-openstack-request-id: req-f469cc87-9db4-4949-8ede-4d9de2604030 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:08:08.106005 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "83aa8649-9e05-4730-8b11-e8ee2387d111", "name": "network-vif-plugged", "status": "completed", "tag": "de252d43-b5e2-49ef-8e0c-6b09c062aff6", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:08:08.106005 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-f469cc87-9db4-4949-8ede-4d9de2604030 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:08:08.106005 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6', 'code': 200} Jun 17 11:08:08.160735 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:08.161904 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 787f2fec-2d83-44f5-9283-874e16102ce0 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:08:08.163886 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:08.238311 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=de252d43-b5e2-49ef-8e0c-6b09c062aff6,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:08.241449 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:08.473188 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-813f17a6-c7bd-4458-9eb8-4391fbd0f2e7 req-cf72bc81-f695-40a8-8292-ec805bb923be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:08.474617 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-813f17a6-c7bd-4458-9eb8-4391fbd0f2e7 req-cf72bc81-f695-40a8-8292-ec805bb923be service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 1099 time: 0.0534186 Jun 17 11:08:08.513999 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-813f17a6-c7bd-4458-9eb8-4391fbd0f2e7 req-685aa208-8874-4022-ae65-12f522df37e6 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325739 Jun 17 11:08:09.110218 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4016bbc-2108-4f9a-8d5e-710694390e6f req-213dfadf-fd1e-4f3d-afb9-f5abcead6b69 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:09.111715 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b4016bbc-2108-4f9a-8d5e-710694390e6f req-213dfadf-fd1e-4f3d-afb9-f5abcead6b69 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 946 time: 0.0744777 Jun 17 11:08:09.190290 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a1f3432-998e-4ac7-b94e-886854592fde req-651c58a2-d90b-4d33-8075-249af7774f82 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:09.191806 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1a1f3432-998e-4ac7-b94e-886854592fde req-651c58a2-d90b-4d33-8075-249af7774f82 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0643024 Jun 17 11:08:09.208219 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b4016bbc-2108-4f9a-8d5e-710694390e6f req-e9007433-2aee-4a4c-a534-3d9ac91d009a tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0741937 Jun 17 11:08:09.225868 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-27b2b6f5-3ba2-43ec-bd43-e1a929dae2df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:09.227490 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-27b2b6f5-3ba2-43ec-bd43-e1a929dae2df service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5&tenant_id=e96eb64d17bd425d9b0a15bc07c55136 HTTP/1.1" status: 200 len: 1096 time: 0.1148896 Jun 17 11:08:09.232682 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1a1f3432-998e-4ac7-b94e-886854592fde req-1d51c1cb-9d30-4e57-ab2d-8644cd25effd tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343361 Jun 17 11:08:09.301332 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-8e8bafff-5db3-4b9f-a177-57c86d9b1339 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:09.302677 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-8e8bafff-5db3-4b9f-a177-57c86d9b1339 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 1096 time: 0.0522540 Jun 17 11:08:09.395781 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-a4dc6066-0265-4b8a-bad8-a937862b7bec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:09.397223 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-a4dc6066-0265-4b8a-bad8-a937862b7bec service neutron] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 918 time: 0.0865457 Jun 17 11:08:09.463537 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-e09e5ca0-b43e-4474-aea3-824d2b7ddf5d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=787f2fec-2d83-44f5-9283-874e16102ce0 HTTP/1.1" status: 200 len: 998 time: 0.0568945 Jun 17 11:08:09.509179 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-8cfbe43a-1360-4a65-898e-f063c337102c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:09.511400 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-8cfbe43a-1360-4a65-898e-f063c337102c service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0417943 Jun 17 11:08:09.569498 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-ab988126-572e-40ae-a9cd-80d6095bd941 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:09.570959 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-ab988126-572e-40ae-a9cd-80d6095bd941 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0530698 Jun 17 11:08:09.658243 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-1222d326-0bbd-4167-825e-fc2fadf63cda service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0799975 Jun 17 11:08:09.754502 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-589c9ddc-80d2-4192-93df-25aa1b9eac77 req-24bda83f-401f-4725-87b2-f0db87684031 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863996 Jun 17 11:08:10.428128 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7f8fb7-43bc-4369-862c-56a4c416952c req-19dca693-4534-4f44-99f8-92794c7f300d tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:10.430971 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3d7f8fb7-43bc-4369-862c-56a4c416952c req-19dca693-4534-4f44-99f8-92794c7f300d tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 946 time: 0.1038208 Jun 17 11:08:10.448506 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f2989ed-9b08-4951-a20f-e0c11f71e23a req-fa62a699-d8e3-40bc-b446-930fecd6fe78 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:10.458755 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8f2989ed-9b08-4951-a20f-e0c11f71e23a req-fa62a699-d8e3-40bc-b446-930fecd6fe78 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0983989 Jun 17 11:08:10.513593 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3d7f8fb7-43bc-4369-862c-56a4c416952c req-3a563585-e30a-4ff0-bcda-ea74f0a03b97 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0728381 Jun 17 11:08:10.514546 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8f2989ed-9b08-4951-a20f-e0c11f71e23a req-91e9f130-39df-465f-8401-c79af7f1ea00 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538738 Jun 17 11:08:10.736317 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0eb9c0-1a69-4d15-b029-0815f7a6c582 req-8cd2addf-52b6-4a88-ad32-02cff467c51d tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:10.737895 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e0eb9c0-1a69-4d15-b029-0815f7a6c582 req-8cd2addf-52b6-4a88-ad32-02cff467c51d tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 946 time: 0.0962012 Jun 17 11:08:10.748463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40462) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:10.753846 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-2b92ae22-763e-4bfc-913c-fe189eb56525 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Request body: {'floatingip': {'port_id': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:08:10.796594 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2b92ae22-763e-4bfc-913c-fe189eb56525 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:11.258768 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2b92ae22-763e-4bfc-913c-fe189eb56525 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:11.329330 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2b92ae22-763e-4bfc-913c-fe189eb56525 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:11.448558 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.l3_db [None req-2b92ae22-763e-4bfc-913c-fe189eb56525 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Floating IP 986d4b31-0924-4404-a37a-0b55a5f9e176 associated. External IP: 172.27.3.158, port: de252d43-b5e2-49ef-8e0c-6b09c062aff6. Jun 17 11:08:11.743061 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97f05b40-e4c7-4091-bc98-33aaac4d98b4 req-99bc9049-6b06-472f-888f-c7b0ffffd085 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:11.745529 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-97f05b40-e4c7-4091-bc98-33aaac4d98b4 req-99bc9049-6b06-472f-888f-c7b0ffffd085 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0929155 Jun 17 11:08:11.795132 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-97f05b40-e4c7-4091-bc98-33aaac4d98b4 req-7b93de8d-37a7-4684-b83b-9457382c4f5b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435715 Jun 17 11:08:11.959650 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b92ae22-763e-4bfc-913c-fe189eb56525 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Router a17f3ab0-fe2c-4834-806d-28b3794b6366 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:08:12.074724 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b92ae22-763e-4bfc-913c-fe189eb56525 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:08:12.079588 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-2b92ae22-763e-4bfc-913c-fe189eb56525 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:12.084286 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3add7874-b9ca-47b3-9a4c-75809addb33c None None] Sync routers for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:08:12.095402 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3add7874-b9ca-47b3-9a4c-75809addb33c None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:08:12.096412 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-3add7874-b9ca-47b3-9a4c-75809addb33c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:07:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:12.126514 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-2b92ae22-763e-4bfc-913c-fe189eb56525 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "PUT /v2.0/floatingips/986d4b31-0924-4404-a37a-0b55a5f9e176 HTTP/1.1" status: 200 len: 992 time: 1.3768399 Jun 17 11:08:12.127205 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'tag': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:08:12.129997 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ac26220-3f91-4807-82f9-46961339ed71" -d '{"events": [{"name": "network-changed", "server_uuid": "83aa8649-9e05-4730-8b11-e8ee2387d111", "tag": "de252d43-b5e2-49ef-8e0c-6b09c062aff6"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:08:12.191876 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:08:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95de95a5-036e-4d3e-8af0-8aa29cc9e630 x-openstack-request-id: req-95de95a5-036e-4d3e-8af0-8aa29cc9e630 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:08:12.193069 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "83aa8649-9e05-4730-8b11-e8ee2387d111", "tag": "de252d43-b5e2-49ef-8e0c-6b09c062aff6", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:08:12.193760 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-95de95a5-036e-4d3e-8af0-8aa29cc9e630 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:08:12.194396 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'tag': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6', 'status': 'completed', 'code': 200} Jun 17 11:08:12.236739 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-3add7874-b9ca-47b3-9a4c-75809addb33c None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:08:12.486522 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-3add7874-b9ca-47b3-9a4c-75809addb33c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '986d4b31-0924-4404-a37a-0b55a5f9e176', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'floating_ip_address': '172.27.3.158', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'port_id': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 591, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'mac_address': 'fa:16:3e:2b:cf:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:07:54Z', 'updated_at': '2021-06-17T11:08:11Z', 'revision_number': 1, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:12.515615 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3add7874-b9ca-47b3-9a4c-75809addb33c None None] Checking router: a17f3ab0-fe2c-4834-806d-28b3794b6366 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:08:12.524484 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3add7874-b9ca-47b3-9a4c-75809addb33c None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:08:12.525114 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-3add7874-b9ca-47b3-9a4c-75809addb33c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:07:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:12.645728 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-3add7874-b9ca-47b3-9a4c-75809addb33c None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:08:12.917779 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-3add7874-b9ca-47b3-9a4c-75809addb33c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '986d4b31-0924-4404-a37a-0b55a5f9e176', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'floating_ip_address': '172.27.3.158', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'port_id': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 591, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'mac_address': 'fa:16:3e:2b:cf:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:07:54Z', 'updated_at': '2021-06-17T11:08:11Z', 'revision_number': 1, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:13.020106 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c192c07-57ea-4ec5-b867-51bed1c20ed2 req-45b2b80f-956a-4b06-b394-5170b5062d26 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:13.022064 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6c192c07-57ea-4ec5-b867-51bed1c20ed2 req-45b2b80f-956a-4b06-b394-5170b5062d26 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0759196 Jun 17 11:08:13.066715 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6c192c07-57ea-4ec5-b867-51bed1c20ed2 req-91753d47-f89c-46e4-9d74-0b7239943bcb tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390332 Jun 17 11:08:13.078009 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3add7874-b9ca-47b3-9a4c-75809addb33c None None] The sync data for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi is: [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '986d4b31-0924-4404-a37a-0b55a5f9e176', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'floating_ip_address': '172.27.3.158', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'port_id': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 591, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'mac_address': 'fa:16:3e:2b:cf:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:07:54Z', 'updated_at': '2021-06-17T11:08:11Z', 'revision_number': 1, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:08:13.285707 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1fa45bd-9936-48c4-96cb-a991901d130c None None] New status for floating IP 986d4b31-0924-4404-a37a-0b55a5f9e176: ACTIVE {{(pid=110218) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:08:14.262682 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2600206b-a525-46c0-bfc6-bd00d31245fc req-8ba35ac4-c154-4729-82f3-fc8bd77416bc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:14.264277 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2600206b-a525-46c0-bfc6-bd00d31245fc req-8ba35ac4-c154-4729-82f3-fc8bd77416bc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0727739 Jun 17 11:08:14.309459 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2600206b-a525-46c0-bfc6-bd00d31245fc req-2311b442-a7b0-437b-bc45-65a7ccee24a3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343764 Jun 17 11:08:15.502648 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64da069d-f991-4838-9369-3995090ddccd req-81be923c-18e0-42a0-b1cb-cebd577cefca tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:15.504289 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-64da069d-f991-4838-9369-3995090ddccd req-81be923c-18e0-42a0-b1cb-cebd577cefca tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0677068 Jun 17 11:08:15.543035 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-64da069d-f991-4838-9369-3995090ddccd req-8e40a161-e2f0-419a-a7ad-9ed2550795b9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316672 Jun 17 11:08:16.723364 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86fe2534-ebb3-4f32-b013-2a022897f911 req-4a3bbc4e-242d-4fe2-8908-9a4467e4d620 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:16.724914 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-86fe2534-ebb3-4f32-b013-2a022897f911 req-4a3bbc4e-242d-4fe2-8908-9a4467e4d620 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0651922 Jun 17 11:08:16.772393 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-86fe2534-ebb3-4f32-b013-2a022897f911 req-7e9cacbc-286a-491b-a568-9c6c40092a34 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372825 Jun 17 11:08:17.957155 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3617cd49-9696-4854-872a-0fefb9b9e415 req-6dedde34-c844-4a69-96de-299f0389b70c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:17.958521 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3617cd49-9696-4854-872a-0fefb9b9e415 req-6dedde34-c844-4a69-96de-299f0389b70c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0645566 Jun 17 11:08:17.996387 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3617cd49-9696-4854-872a-0fefb9b9e415 req-c9881907-85c9-4843-900e-f2d0c26a4154 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318394 Jun 17 11:08:19.182005 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2ebf89-48d8-4230-874b-c7187b9b108c req-befb3ad8-612c-4371-b4b9-e57f79116db3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:19.183534 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fa2ebf89-48d8-4230-874b-c7187b9b108c req-befb3ad8-612c-4371-b4b9-e57f79116db3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0659904 Jun 17 11:08:19.222975 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fa2ebf89-48d8-4230-874b-c7187b9b108c req-98d0dc22-1349-47d4-9a59-870d138c63c3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0334606 Jun 17 11:08:20.413511 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1fc28a5-d358-4df0-804a-4513a0c69d79 req-b69fe220-3a5c-4381-b9a0-22c5e20f411a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:20.414882 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c1fc28a5-d358-4df0-804a-4513a0c69d79 req-b69fe220-3a5c-4381-b9a0-22c5e20f411a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0665975 Jun 17 11:08:20.453101 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c1fc28a5-d358-4df0-804a-4513a0c69d79 req-22c8b71e-2c61-4930-8340-28729c598d25 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0326445 Jun 17 11:08:20.660927 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-67b73834-0bc2-456e-9e53-30150a688b94 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:21.645047 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7715d4ba-d3e6-4d53-b212-b1b3a62f6a7c req-738c11c5-6345-4157-ab3b-d3ade2f6c694 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:21.646578 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7715d4ba-d3e6-4d53-b212-b1b3a62f6a7c req-738c11c5-6345-4157-ab3b-d3ade2f6c694 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0638528 Jun 17 11:08:21.685817 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7715d4ba-d3e6-4d53-b212-b1b3a62f6a7c req-77201eb6-a8dc-4bd6-85ee-c9eaa4444e9a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0335457 Jun 17 11:08:22.756944 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a8c05e8e-2ba5-434e-b51e-39a42f558099 req-573d6bec-845c-4cd5-b08d-1a811c707f09 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1466596722&fields=id&tenant_id=ed69cf6aa40941c48c25effb0c1af8fc HTTP/1.1" status: 200 len: 267 time: 0.0331521 Jun 17 11:08:22.826631 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c05e8e-2ba5-434e-b51e-39a42f558099 req-fe3c9f7f-70c6-4378-b9e5-95f16bbed4d5 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:22.828173 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a8c05e8e-2ba5-434e-b51e-39a42f558099 req-fe3c9f7f-70c6-4378-b9e5-95f16bbed4d5 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 985 time: 0.0655608 Jun 17 11:08:22.839068 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [req-a8c05e8e-2ba5-434e-b51e-39a42f558099 req-4beda069-2baf-495d-b959-001bdea9030b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Request body: {'port': {'security_groups': ['d13c205a-f6de-4b53-abc9-1484c3d728be']}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:08:22.930482 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-a8c05e8e-2ba5-434e-b51e-39a42f558099 req-4beda069-2baf-495d-b959-001bdea9030b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.104163 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [req-a8c05e8e-2ba5-434e-b51e-39a42f558099 req-4beda069-2baf-495d-b959-001bdea9030b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] For port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:23.133262 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-a8c05e8e-2ba5-434e-b51e-39a42f558099 req-4beda069-2baf-495d-b959-001bdea9030b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.176824 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-a8c05e8e-2ba5-434e-b51e-39a42f558099 req-4beda069-2baf-495d-b959-001bdea9030b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.180862 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6079b2a7-402f-44ce-88b4-e131566ce76b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:23.196335 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:08:23.227900 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c05e8e-2ba5-434e-b51e-39a42f558099 req-4beda069-2baf-495d-b959-001bdea9030b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:23.228579 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-a8c05e8e-2ba5-434e-b51e-39a42f558099 req-4beda069-2baf-495d-b959-001bdea9030b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.229951 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a8c05e8e-2ba5-434e-b51e-39a42f558099 req-4beda069-2baf-495d-b959-001bdea9030b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "PUT /v2.0/ports/5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 HTTP/1.1" status: 200 len: 943 time: 0.3955495 Jun 17 11:08:23.230482 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'}] {{(pid=110214) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:08:23.232912 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cc2cf72888dbbd14a3b8c118b05d43e907687f619eecab2abc2da29781eba8b9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5e844497-0823-4684-a722-5c4f8d14b127" -d '{"events": [{"name": "network-changed", "server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72"}]}' {{(pid=110214) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:08:23.237452 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40506) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:23.263921 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4beda069-2baf-495d-b959-001bdea9030b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event updated for resources: {'Port': ['ID=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,revision_number=7']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:23.268023 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-4beda069-2baf-495d-b959-001bdea9030b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:23.334085 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.368568 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.407604 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:08:23.424942 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c600eac-7f27-4b84-8c1a-6b6a2345c3b1 req-2d74f38f-9ce8-49d9-b08e-c070f0fdde12 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:23.426586 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8c600eac-7f27-4b84-8c1a-6b6a2345c3b1 req-2d74f38f-9ce8-49d9-b08e-c070f0fdde12 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0721509 Jun 17 11:08:23.430104 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-87b720a6-9fc7-4e76-9560-008c6e555498 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.475834 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8c600eac-7f27-4b84-8c1a-6b6a2345c3b1 req-8cf8413d-79b8-4ea0-a753-d0a0cf6273cf tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388970 Jun 17 11:08:23.524801 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.527393 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.528755 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "DELETE /v2.0/security-groups/e981b014-56d8-44c5-8806-e0c8684083c6 HTTP/1.1" status: 204 len: 168 time: 0.2903507 Jun 17 11:08:23.529739 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5c5b9ba4-ebf8-4543-9f31-91951713f209 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:23.531557 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 40508) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:23.538671 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e981b014-56d8-44c5-8806-e0c8684083c6,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:23.545782 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.546168 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.546543 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.546936 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.547302 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.547836 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.548208 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.548951 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.548951 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.549566 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.549957 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.550351 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:23.552917 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2b19d82a-07c0-4812-8e80-15b843e6c316 None None] Provisioning complete for port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:08:23.553330 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2b19d82a-07c0-4812-8e80-15b843e6c316 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.553483 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:23.567668 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:08:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-338325e8-7ee0-4ef3-acad-eccc16d28fff x-openstack-request-id: req-338325e8-7ee0-4ef3-acad-eccc16d28fff {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:08:23.568000 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72", "status": "completed", "code": 200}]} {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:08:23.568810 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-338325e8-7ee0-4ef3-acad-eccc16d28fff {{(pid=110214) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:08:23.568810 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'status': 'completed', 'code': 200} Jun 17 11:08:23.624687 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.916277 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Deleting port 77ff7dd1-d2da-4628-97dc-0ba8cf667284 {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:08:23.916848 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.989143 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:23.989463 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:24.051127 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Calling delete_port for 77ff7dd1-d2da-4628-97dc-0ba8cf667284 owned by network:floatingip {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:08:24.313881 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:24.315940 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:24.339324 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event deleted for resources: {'Port': ['ID=77ff7dd1-d2da-4628-97dc-0ba8cf667284,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:24.341767 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:24.400072 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks [] for floatingip, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:24.400396 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.l3_db [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Floating IP 6dda487f-5f27-4ebc-af57-7e83920b52d2 disassociated (deleted). External IP: 172.27.3.15, port: 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72. Jun 17 11:08:24.471870 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:24.635106 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:08:24.733104 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52d744a9-fc83-48ee-ad50-0219d0d9b8c3 req-a49a9136-e64c-462e-aaaa-1d55e2e0c30d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:24.734555 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-52d744a9-fc83-48ee-ad50-0219d0d9b8c3 req-a49a9136-e64c-462e-aaaa-1d55e2e0c30d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.1315544 Jun 17 11:08:24.790558 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-52d744a9-fc83-48ee-ad50-0219d0d9b8c3 req-f6050a10-2176-4964-a158-7198eba4d05e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493555 Jun 17 11:08:24.793065 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:08:24.797728 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:24.802376 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5185bdba-684f-475c-86ef-b34c01d68b51 None None] Sync routers for ids ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:08:24.811231 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5185bdba-684f-475c-86ef-b34c01d68b51 None None] Routers {'7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:08:24.811865 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5185bdba-684f-475c-86ef-b34c01d68b51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:08:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:24.836669 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "DELETE /v2.0/floatingips/6dda487f-5f27-4ebc-af57-7e83920b52d2 HTTP/1.1" status: 204 len: 168 time: 1.3040226 Jun 17 11:08:24.918335 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-5185bdba-684f-475c-86ef-b34c01d68b51 None None] Set router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:08:25.048471 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:08:25.109418 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5185bdba-684f-475c-86ef-b34c01d68b51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 4, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'fc90a0fd-7ca9-4a92-a265-28ce1dd9160f', 'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'mac_address': 'fa:16:3e:88:9a:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:27Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 5, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'subnets': [{'id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:25.139414 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5185bdba-684f-475c-86ef-b34c01d68b51 None None] Checking router: 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:08:25.148217 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5185bdba-684f-475c-86ef-b34c01d68b51 None None] Routers {'7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:08:25.148839 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5185bdba-684f-475c-86ef-b34c01d68b51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:08:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:25.251711 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-5185bdba-684f-475c-86ef-b34c01d68b51 None None] Set router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:08:25.442930 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5185bdba-684f-475c-86ef-b34c01d68b51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 4, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'fc90a0fd-7ca9-4a92-a265-28ce1dd9160f', 'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'mac_address': 'fa:16:3e:88:9a:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:27Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 5, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'subnets': [{'id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:25.467539 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5185bdba-684f-475c-86ef-b34c01d68b51 None None] The sync data for ids ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'] in dv-cinder-773870-6-iscsi is: [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:03:27Z', 'revision_number': 4, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'fc90a0fd-7ca9-4a92-a265-28ce1dd9160f', 'name': '', 'network_id': 'aeced3ed-7670-4043-a385-87de6f75150b', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'mac_address': 'fa:16:3e:88:9a:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:27Z', 'updated_at': '2021-06-17T11:03:34Z', 'revision_number': 5, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'subnets': [{'id': '5d332463-1c62-46e2-a7e3-4b587a2e5f1e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:08:25.569449 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'}] {{(pid=110214) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:08:25.571868 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cc2cf72888dbbd14a3b8c118b05d43e907687f619eecab2abc2da29781eba8b9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5" -d '{"events": [{"name": "network-changed", "server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72"}]}' {{(pid=110214) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:08:25.607513 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:08:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1c81f268-b1ac-41b1-a819-64f56189a4b3 x-openstack-request-id: req-1c81f268-b1ac-41b1-a819-64f56189a4b3 {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:08:25.607839 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72", "status": "completed", "code": 200}]} {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:08:25.608123 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-1c81f268-b1ac-41b1-a819-64f56189a4b3 {{(pid=110214) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:08:25.608661 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'status': 'completed', 'code': 200} Jun 17 11:08:25.665424 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da2b9d29-68a8-4ef7-8342-26945232d3c2 None None] New status for floating IP 6dda487f-5f27-4ebc-af57-7e83920b52d2: DOWN {{(pid=110218) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:08:25.979875 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0015b124-fcca-451d-902c-fd5dba19946a req-e61d1683-60d9-4393-9e5a-4ef93bf1913f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:25.981289 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0015b124-fcca-451d-902c-fd5dba19946a req-e61d1683-60d9-4393-9e5a-4ef93bf1913f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0610945 Jun 17 11:08:26.016859 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0015b124-fcca-451d-902c-fd5dba19946a req-0c46050a-780d-4adb-b494-f3d8fc8fb958 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0299850 Jun 17 11:08:26.772479 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac26220-3f91-4807-82f9-46961339ed71 req-259a09bf-181f-4c89-bf74-9a753fd8dd2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:26.773948 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ac26220-3f91-4807-82f9-46961339ed71 req-259a09bf-181f-4c89-bf74-9a753fd8dd2e service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 1099 time: 0.0856605 Jun 17 11:08:26.776316 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e844497-0823-4684-a722-5c4f8d14b127 req-70f7dd08-726f-4f3a-9abf-26f0d85d00b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:26.777624 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5e844497-0823-4684-a722-5c4f8d14b127 req-70f7dd08-726f-4f3a-9abf-26f0d85d00b8 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ed69cf6aa40941c48c25effb0c1af8fc&device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 1099 time: 0.0979588 Jun 17 11:08:26.827385 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:26.938254 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e844497-0823-4684-a722-5c4f8d14b127 req-b48d602f-a290-49a3-9118-d2a9a5b91229 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:26.939777 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5e844497-0823-4684-a722-5c4f8d14b127 req-b48d602f-a290-49a3-9118-d2a9a5b91229 service neutron] 10.222.0.25 "GET /v2.0/networks?id=aeced3ed-7670-4043-a385-87de6f75150b HTTP/1.1" status: 200 len: 916 time: 0.1455972 Jun 17 11:08:26.940826 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac26220-3f91-4807-82f9-46961339ed71 req-7dbcd704-00c3-4308-b4c1-2da5f1a12a52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:26.942121 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ac26220-3f91-4807-82f9-46961339ed71 req-7dbcd704-00c3-4308-b4c1-2da5f1a12a52 service neutron] 10.222.0.25 "GET /v2.0/networks?id=54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 200 len: 911 time: 0.1550961 Jun 17 11:08:27.023775 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5e844497-0823-4684-a722-5c4f8d14b127 req-fa06d41a-29e2-41bd-b509-2596ced74e21 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 HTTP/1.1" status: 200 len: 217 time: 0.0654035 Jun 17 11:08:27.076705 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ac26220-3f91-4807-82f9-46961339ed71 req-0e0949a7-e715-4eea-842c-af7033b09fba service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=de252d43-b5e2-49ef-8e0c-6b09c062aff6 HTTP/1.1" status: 200 len: 1002 time: 0.1172450 Jun 17 11:08:27.083951 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e844497-0823-4684-a722-5c4f8d14b127 req-a1ad7c61-46ea-4594-ae70-9f48de3918df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:27.085323 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5e844497-0823-4684-a722-5c4f8d14b127 req-a1ad7c61-46ea-4594-ae70-9f48de3918df service neutron] 10.222.0.25 "GET /v2.0/subnets?id=5d332463-1c62-46e2-a7e3-4b587a2e5f1e HTTP/1.1" status: 200 len: 854 time: 0.0539241 Jun 17 11:08:27.163009 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac26220-3f91-4807-82f9-46961339ed71 req-e0cc9b71-1079-43f9-af5a-872bf5ea70e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:27.164506 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ac26220-3f91-4807-82f9-46961339ed71 req-e0cc9b71-1079-43f9-af5a-872bf5ea70e3 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 200 len: 849 time: 0.0726519 Jun 17 11:08:27.194267 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5660c4f-1da0-420f-a2fc-4a07a49f6d25 req-9b4b0d5d-5f2e-4983-81f0-eeb11c74f5ca tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:27.195780 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b5660c4f-1da0-420f-a2fc-4a07a49f6d25 req-9b4b0d5d-5f2e-4983-81f0-eeb11c74f5ca tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0653391 Jun 17 11:08:27.207240 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e844497-0823-4684-a722-5c4f8d14b127 req-ab51e5be-753b-43ad-940d-4718f92cac76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:27.208549 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5e844497-0823-4684-a722-5c4f8d14b127 req-ab51e5be-753b-43ad-940d-4718f92cac76 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=aeced3ed-7670-4043-a385-87de6f75150b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1156161 Jun 17 11:08:27.233837 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b5660c4f-1da0-420f-a2fc-4a07a49f6d25 req-b2c4642d-c340-437a-b40d-2cc805aa4b13 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0324745 Jun 17 11:08:27.257757 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac26220-3f91-4807-82f9-46961339ed71 req-fdd9f417-e2c3-4cc3-a028-7413c07cd7e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:27.259270 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ac26220-3f91-4807-82f9-46961339ed71 req-fdd9f417-e2c3-4cc3-a028-7413c07cd7e9 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=54973ccd-0b2b-4517-ad28-76a3128a2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0870280 Jun 17 11:08:27.365930 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5e844497-0823-4684-a722-5c4f8d14b127 req-06d06270-9fdf-48b1-9497-a71b6af340a4 service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1434181 Jun 17 11:08:27.403726 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ac26220-3f91-4807-82f9-46961339ed71 req-2c50942a-ab01-4add-9a78-9808cc11737d service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1140947 Jun 17 11:08:27.525923 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5e844497-0823-4684-a722-5c4f8d14b127 req-6f35b6de-e967-497c-bc54-78b4de4581d1 service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1514337 Jun 17 11:08:27.544367 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ac26220-3f91-4807-82f9-46961339ed71 req-99856539-089d-4db9-836b-ddbe182c06b8 service neutron] 10.222.0.25 "GET /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1279113 Jun 17 11:08:27.691042 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5 req-35ce5d0e-dd9a-4ba7-bb9f-1c25a37a68e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:27.692499 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5 req-35ce5d0e-dd9a-4ba7-bb9f-1c25a37a68e6 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=ed69cf6aa40941c48c25effb0c1af8fc&device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 1099 time: 0.0513828 Jun 17 11:08:27.780640 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5 req-6b2d49b8-1549-440b-9ece-68e9f177ccc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:27.782073 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5 req-6b2d49b8-1549-440b-9ece-68e9f177ccc7 service neutron] 10.222.0.25 "GET /v2.0/networks?id=aeced3ed-7670-4043-a385-87de6f75150b HTTP/1.1" status: 200 len: 916 time: 0.0830979 Jun 17 11:08:27.829956 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5 req-c1a432ed-2dcc-4a1e-a533-c2fa584e9982 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 HTTP/1.1" status: 200 len: 217 time: 0.0373080 Jun 17 11:08:27.887680 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5 req-9f6c5c1f-973f-487e-ac6b-37805ec563bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:27.889092 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5 req-9f6c5c1f-973f-487e-ac6b-37805ec563bc service neutron] 10.222.0.25 "GET /v2.0/subnets?id=5d332463-1c62-46e2-a7e3-4b587a2e5f1e HTTP/1.1" status: 200 len: 854 time: 0.0455627 Jun 17 11:08:27.944875 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5 req-49553011-824a-4936-b8e8-7ef935b8c597 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:27.946210 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5 req-49553011-824a-4936-b8e8-7ef935b8c597 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=aeced3ed-7670-4043-a385-87de6f75150b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0498736 Jun 17 11:08:28.035815 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5 req-6dd10089-b042-4c3c-8d97-fcff838ed226 service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816746 Jun 17 11:08:28.122518 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79c08c6d-9521-4b47-ad7a-b2ddaa33c7f5 req-cc6ea220-548b-447e-a6cb-136956fc0091 service neutron] 10.222.0.25 "GET /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798864 Jun 17 11:08:28.415718 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8048da21-fcc1-4973-b1da-e4a596bf8fd4 req-76991950-25a8-459b-b29e-979894940f09 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:28.417165 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8048da21-fcc1-4973-b1da-e4a596bf8fd4 req-76991950-25a8-459b-b29e-979894940f09 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0663760 Jun 17 11:08:28.453052 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8048da21-fcc1-4973-b1da-e4a596bf8fd4 req-7b473f46-e481-407c-aedd-486a1b3248ef tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303347 Jun 17 11:08:29.640251 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a649cd7-a394-4dd1-a76a-96555e5b226d req-764eb8b2-c9ed-4fd5-977f-d81cc58dbf06 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:29.641706 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5a649cd7-a394-4dd1-a76a-96555e5b226d req-764eb8b2-c9ed-4fd5-977f-d81cc58dbf06 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0640745 Jun 17 11:08:29.679443 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5a649cd7-a394-4dd1-a76a-96555e5b226d req-bca15776-ffce-482d-b696-dd3d8c04522f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316534 Jun 17 11:08:30.708167 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ed00e2-3529-4016-9639-d3b8ad4b3248 req-7b2e6642-f88f-4491-b3df-5a07518da64c tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:30.709816 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-68ed00e2-3529-4016-9639-d3b8ad4b3248 req-7b2e6642-f88f-4491-b3df-5a07518da64c tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 946 time: 0.0620155 Jun 17 11:08:30.746657 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-68ed00e2-3529-4016-9639-d3b8ad4b3248 req-452eb4f7-7683-4885-abef-a1172153b74d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312977 Jun 17 11:08:30.875477 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4676c1ce-e062-4cea-99db-36ff4aadc311 req-82ff4127-7a68-4858-8c68-7c8fae8df0f0 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:30.877517 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4676c1ce-e062-4cea-99db-36ff4aadc311 req-82ff4127-7a68-4858-8c68-7c8fae8df0f0 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0658717 Jun 17 11:08:30.915100 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4676c1ce-e062-4cea-99db-36ff4aadc311 req-18949446-e2a8-432d-be27-30f156e180b3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316765 Jun 17 11:08:31.930524 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e269dc5-5c1d-4a40-9bf5-339b1db9295a req-4d2a89e9-2724-47a8-a4f1-6e40482da0f1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:31.932012 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6e269dc5-5c1d-4a40-9bf5-339b1db9295a req-4d2a89e9-2724-47a8-a4f1-6e40482da0f1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 946 time: 0.0755093 Jun 17 11:08:31.969197 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6e269dc5-5c1d-4a40-9bf5-339b1db9295a req-04347efe-6765-46aa-83b0-44709c7a2ba2 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315340 Jun 17 11:08:32.096879 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2306c6c-d057-4190-bf70-fa3cb6de33a8 req-cbc5e468-081e-48a0-96f5-f244fbfbfe63 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:32.098369 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a2306c6c-d057-4190-bf70-fa3cb6de33a8 req-cbc5e468-081e-48a0-96f5-f244fbfbfe63 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0622361 Jun 17 11:08:32.135929 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a2306c6c-d057-4190-bf70-fa3cb6de33a8 req-c0f0e6da-eef3-4122-a375-4701f2581ee4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318403 Jun 17 11:08:33.144423 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c42778-1974-438a-a21b-64df7f0ae2e7 req-f672189c-e6c6-419e-8ebe-44d71a78820d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:33.145910 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-06c42778-1974-438a-a21b-64df7f0ae2e7 req-f672189c-e6c6-419e-8ebe-44d71a78820d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 946 time: 0.0671518 Jun 17 11:08:33.183458 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-06c42778-1974-438a-a21b-64df7f0ae2e7 req-9e47ed59-c2b4-4896-b49f-170815441961 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/security-groups?id=d13c205a-f6de-4b53-abc9-1484c3d728be&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316677 Jun 17 11:08:33.316734 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08a6e8b-a581-4cbd-bb4d-09f419efbba9 req-e7df1030-ba81-416b-908b-fd4212585a67 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:33.318093 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e08a6e8b-a581-4cbd-bb4d-09f419efbba9 req-e7df1030-ba81-416b-908b-fd4212585a67 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0630529 Jun 17 11:08:33.387883 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e08a6e8b-a581-4cbd-bb4d-09f419efbba9 req-1b0b4a01-ef47-4983-8ebb-f03da6d62284 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0630252 Jun 17 11:08:33.413070 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5923063-babf-4145-b548-2eecd1094a8a req-d2d221aa-1a7f-42ea-9d8f-deab687d1140 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:33.414569 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e5923063-babf-4145-b548-2eecd1094a8a req-d2d221aa-1a7f-42ea-9d8f-deab687d1140 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.25 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 946 time: 0.0907888 Jun 17 11:08:33.514738 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-e5923063-babf-4145-b548-2eecd1094a8a req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Deleting port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:08:33.515106 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-e5923063-babf-4145-b548-2eecd1094a8a req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:33.600731 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-e5923063-babf-4145-b548-2eecd1094a8a req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] For port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:33.601084 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-e5923063-babf-4145-b548-2eecd1094a8a req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:33.660780 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-e5923063-babf-4145-b548-2eecd1094a8a req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Calling delete_port for 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:08:33.831568 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-e5923063-babf-4145-b548-2eecd1094a8a req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:33.835546 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-fbe63c64-cc86-4ea5-b623-5045c3669f05 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:33.844428 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:08:33.860864 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Pushing event deleted for resources: {'Port': ['ID=5c1891f0-4e28-4fb7-9fc3-1e92c03cef72,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:33.864857 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:33.917626 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5923063-babf-4145-b548-2eecd1094a8a req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] No DVR routers for this DVR port 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:08:33.920569 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-e5923063-babf-4145-b548-2eecd1094a8a req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:33.922176 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e5923063-babf-4145-b548-2eecd1094a8a req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.25 "DELETE /v2.0/ports/5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 HTTP/1.1" status: 204 len: 173 time: 0.4991596 Jun 17 11:08:33.922688 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'name': 'network-vif-deleted', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:08:33.925711 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2692a70b-4b32-427f-9bb7-d686f42f7502" -d '{"events": [{"server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "name": "network-vif-deleted", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:08:33.961781 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:08:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5bd078d-1f00-4f95-8302-b9e8b0410948 x-openstack-request-id: req-c5bd078d-1f00-4f95-8302-b9e8b0410948 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:08:33.962132 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e39d6470-2e58-446d-b534-2051c55caa8a", "name": "network-vif-deleted", "tag": "5c1891f0-4e28-4fb7-9fc3-1e92c03cef72", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:08:33.962420 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-c5bd078d-1f00-4f95-8302-b9e8b0410948 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:08:33.962879 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e39d6470-2e58-446d-b534-2051c55caa8a', 'name': 'network-vif-deleted', 'tag': '5c1891f0-4e28-4fb7-9fc3-1e92c03cef72', 'status': 'completed', 'code': 200} Jun 17 11:08:34.348383 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-02ef3034-3d19-4bb3-8290-4b524fd16297 req-02438d7f-fb2d-4dec-83e8-0750a112f5b1 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] 10.222.0.41 "GET /v2.0/ports?device_id=e39d6470-2e58-446d-b534-2051c55caa8a HTTP/1.1" status: 200 len: 210 time: 0.0288928 Jun 17 11:08:34.570546 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddbe0f70-a2f1-4a5f-a427-3fbd07e843da req-e0ea93bf-e30c-4321-bdb5-a2080ee6baaa tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:34.572039 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ddbe0f70-a2f1-4a5f-a427-3fbd07e843da req-e0ea93bf-e30c-4321-bdb5-a2080ee6baaa tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0642059 Jun 17 11:08:34.611248 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ddbe0f70-a2f1-4a5f-a427-3fbd07e843da req-62028f0f-cc05-4648-9a8d-90c5e1d055ca tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0334063 Jun 17 11:08:35.800576 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6423176a-0043-427f-b6ce-0b3ac34b4a81 req-ba04f510-9150-4339-8bbe-d46e2ad0d94b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:35.800576 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6423176a-0043-427f-b6ce-0b3ac34b4a81 req-ba04f510-9150-4339-8bbe-d46e2ad0d94b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 943 time: 0.0701010 Jun 17 11:08:35.840784 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6423176a-0043-427f-b6ce-0b3ac34b4a81 req-9db7c2de-250e-4836-8c92-3dad1dac5890 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0358145 Jun 17 11:08:36.011696 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 787f2fec-2d83-44f5-9283-874e16102ce0 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:08:36.103073 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:36.114837 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '787f2fec-2d83-44f5-9283-874e16102ce0', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'port_id': '787f2fec-2d83-44f5-9283-874e16102ce0', 'mac_address': 'fa:16:3e:d7:aa:86', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:08:36.151232 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:36.167393 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 787f2fec-2d83-44f5-9283-874e16102ce0 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:08:36.186702 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:36.331238 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:36.333077 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-27faf0d1-2f05-464b-9cbc-af1562788a9f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:36.381150 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=787f2fec-2d83-44f5-9283-874e16102ce0,revision_number=9']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:36.384409 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:36.773607 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['787f2fec-2d83-44f5-9283-874e16102ce0'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:08:36.790085 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40632) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:37.063340 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5700f735-ffdb-4a70-a2b0-be8bdd81390b req-25234b2b-ae97-45fd-a046-94ecab3f363f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:37.065817 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5700f735-ffdb-4a70-a2b0-be8bdd81390b req-25234b2b-ae97-45fd-a046-94ecab3f363f service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 1097 time: 0.2034740 Jun 17 11:08:37.165896 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9668988e-36bf-42d7-b072-d3c1e37fac0c req-7d3da70c-795d-4e1f-9f93-0961e7a745f8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:37.167268 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9668988e-36bf-42d7-b072-d3c1e37fac0c req-7d3da70c-795d-4e1f-9f93-0961e7a745f8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 944 time: 0.1562903 Jun 17 11:08:37.301125 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9668988e-36bf-42d7-b072-d3c1e37fac0c req-5ede243b-ce6c-4951-a5b5-a9591c6150ee tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1021717 Jun 17 11:08:37.305450 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5700f735-ffdb-4a70-a2b0-be8bdd81390b req-00802ec3-6387-4bf8-986a-b30c6a748c41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:37.306933 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5700f735-ffdb-4a70-a2b0-be8bdd81390b req-00802ec3-6387-4bf8-986a-b30c6a748c41 service neutron] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 918 time: 0.2085452 Jun 17 11:08:37.664657 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5700f735-ffdb-4a70-a2b0-be8bdd81390b req-ccb2ec41-17be-4906-a30e-26c7b68a241e service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=787f2fec-2d83-44f5-9283-874e16102ce0 HTTP/1.1" status: 200 len: 999 time: 0.3483737 Jun 17 11:08:37.679944 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:37.733734 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5700f735-ffdb-4a70-a2b0-be8bdd81390b req-7504e064-e939-4f36-8ff5-1163a6fac70f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:37.735194 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5700f735-ffdb-4a70-a2b0-be8bdd81390b req-7504e064-e939-4f36-8ff5-1163a6fac70f service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0525260 Jun 17 11:08:37.830200 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5700f735-ffdb-4a70-a2b0-be8bdd81390b req-6ab053ac-f842-4041-8863-57ab44c7e294 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:37.831713 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5700f735-ffdb-4a70-a2b0-be8bdd81390b req-6ab053ac-f842-4041-8863-57ab44c7e294 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0890155 Jun 17 11:08:37.860999 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8355326'] for router_interface, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:37.998201 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5700f735-ffdb-4a70-a2b0-be8bdd81390b req-9a117e73-8317-4d04-9e3c-45de7893e338 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1568296 Jun 17 11:08:38.016658 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 787f2fec-2d83-44f5-9283-874e16102ce0 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:08:38.067996 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 787f2fec-2d83-44f5-9283-874e16102ce0 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:08:38.068369 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:38.145743 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:38.160143 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5700f735-ffdb-4a70-a2b0-be8bdd81390b req-5c69ee32-544a-43c4-b8e9-8d9c9c3e4dc3 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1514382 Jun 17 11:08:38.169044 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:08:38.171318 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6685485-d45a-4f84-b59f-523d397bba79" -d '{"events": [{"server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "name": "network-vif-plugged", "status": "completed", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:08:38.185061 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:38.213183 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:08:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8da05ed7-6c28-4b1e-baba-191cb787d181 x-openstack-request-id: req-8da05ed7-6c28-4b1e-baba-191cb787d181 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:08:38.213506 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "name": "network-vif-plugged", "status": "completed", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:08:38.213765 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-8da05ed7-6c28-4b1e-baba-191cb787d181 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:08:38.214162 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0', 'code': 200} Jun 17 11:08:38.257010 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Deleting port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:08:38.257269 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:38.277306 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:38.278224 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:08:38.280735 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:38.302027 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:08:38.302376 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 5c1891f0-4e28-4fb7-9fc3-1e92c03cef72 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:08:38.342063 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] For port fc90a0fd-7ca9-4a92-a265-28ce1dd9160f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=fc90a0fd-7ca9-4a92-a265-28ce1dd9160f,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:38.342422 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:38.355946 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=787f2fec-2d83-44f5-9283-874e16102ce0,revision_number=10']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:38.363747 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.364102 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.364438 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.364768 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.365095 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.365595 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.365782 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.366054 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.366377 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.366698 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.367042 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.367358 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:08:38.375039 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:38.410809 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Calling delete_port for fc90a0fd-7ca9-4a92-a265-28ce1dd9160f owned by network:router_interface {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:08:38.503814 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0b06c4f-d008-4b9e-bbdb-a27d6d7c3118 req-1b98e4f3-c031-4c3e-97f2-fd452863f16c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:38.505274 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e0b06c4f-d008-4b9e-bbdb-a27d6d7c3118 req-1b98e4f3-c031-4c3e-97f2-fd452863f16c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 946 time: 0.0637295 Jun 17 11:08:38.547197 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e0b06c4f-d008-4b9e-bbdb-a27d6d7c3118 req-2a892233-b73c-43a2-9a8f-4dcb1d782820 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0356176 Jun 17 11:08:38.655962 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:38.659667 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:38.689814 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=fc90a0fd-7ca9-4a92-a265-28ce1dd9160f,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:38.696128 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:38.855133 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7899567', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8355178'] for router_interface, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:39.097117 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:08:39.098990 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba73f2f3-3fe3-4ac8-bf70-c6aa15d26b18 req-06a4e2d7-6308-46af-af67-0dbdb02b63cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:39.100424 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba73f2f3-3fe3-4ac8-bf70-c6aa15d26b18 req-06a4e2d7-6308-46af-af67-0dbdb02b63cf service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 1099 time: 0.0792909 Jun 17 11:08:39.202110 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba73f2f3-3fe3-4ac8-bf70-c6aa15d26b18 req-12e322cc-6966-40f7-bde6-8fac0e4befc5 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0933356 Jun 17 11:08:39.224550 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:08:39.231596 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] 10.222.0.41 "PUT /v2.0/routers/7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4385424 Jun 17 11:08:39.232234 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40648) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:39.234968 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-033deef8-b50c-4d4c-b9c8-7ed77582ba0c None None] Sync routers for ids ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:08:39.244358 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-033deef8-b50c-4d4c-b9c8-7ed77582ba0c None None] Routers {'7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:08:39.244986 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-033deef8-b50c-4d4c-b9c8-7ed77582ba0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:08:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:39.334798 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Notify callbacks [] for router, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:39.348460 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-033deef8-b50c-4d4c-b9c8-7ed77582ba0c None None] Set router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:08:39.443939 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:39.607737 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Deleting port 2c924c70-c971-4a36-8d58-1335920ceb42 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:08:39.608011 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:39.657143 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-033deef8-b50c-4d4c-b9c8-7ed77582ba0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151'}], 'enable_snat': True}, 'gw_port_id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:08:38Z', 'revision_number': 5, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port': {'id': '2c924c70-c971-4a36-8d58-1335920ceb42', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:98:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.151', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:24Z', 'updated_at': '2021-06-17T11:03:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:39.698988 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] For port 2c924c70-c971-4a36-8d58-1335920ceb42, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=2c924c70-c971-4a36-8d58-1335920ceb42,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:39.699225 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-033deef8-b50c-4d4c-b9c8-7ed77582ba0c None None] Checking router: 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:08:39.699439 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:39.710602 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-033deef8-b50c-4d4c-b9c8-7ed77582ba0c None None] Routers {'7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:08:39.711522 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-033deef8-b50c-4d4c-b9c8-7ed77582ba0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:08:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:39.749079 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d285d3d9-828b-421f-a17e-dbeb1878ddf7 req-f1f3521a-a190-45cc-ae55-c45b348a7770 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:39.751311 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d285d3d9-828b-421f-a17e-dbeb1878ddf7 req-f1f3521a-a190-45cc-ae55-c45b348a7770 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 946 time: 0.0857210 Jun 17 11:08:39.770208 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Calling delete_port for 2c924c70-c971-4a36-8d58-1335920ceb42 owned by network:router_gateway {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:08:39.790302 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d285d3d9-828b-421f-a17e-dbeb1878ddf7 req-1b60eac6-931e-4b88-b12a-c1a65de5f06b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0324771 Jun 17 11:08:39.799113 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-033deef8-b50c-4d4c-b9c8-7ed77582ba0c None None] Set router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f gateway port host: None {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:08:39.851089 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-033deef8-b50c-4d4c-b9c8-7ed77582ba0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:08:39Z', 'revision_number': 6, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port_host': None}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:39.880505 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-033deef8-b50c-4d4c-b9c8-7ed77582ba0c None None] The sync data for ids ['7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f'] in dv-cinder-773870-6-iscsi is: [{'id': '7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f', 'name': 'tempest-TestMinimumBasicScenario-1993744618-router', 'tenant_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:23Z', 'updated_at': '2021-06-17T11:08:39Z', 'revision_number': 6, 'project_id': 'ed69cf6aa40941c48c25effb0c1af8fc', 'gw_port_host': None}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:08:40.049748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.051998 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-1518178e-388f-441d-9423-fba03d5477ff tempest-TestShelveInstance-1237754662 tempest-TestShelveInstance-1237754662-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:40.074958 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Pushing event deleted for resources: {'Port': ['ID=2c924c70-c971-4a36-8d58-1335920ceb42,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:40.077250 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:40.142089 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8286505'] for router_gateway, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.231389 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8357994', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2026'] for router, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.233670 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.380228 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8291427'] for router, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.380770 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f {{(pid=110215) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Jun 17 11:08:40.385786 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Notify callbacks [] for router, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.386933 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] 10.222.0.41 "DELETE /v2.0/routers/7dcfbfb2-90c5-4b85-9e86-4c588e26ce8f HTTP/1.1" status: 204 len: 168 time: 1.1537759 Jun 17 11:08:40.389378 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40652) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:40.431486 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_v2 [None req-e0df35f0-b549-4c04-9ce6-a94226c970ca admin admin] Deleting subnet 5d332463-1c62-46e2-a7e3-4b587a2e5f1e {{(pid=110215) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:08:40.434361 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e0df35f0-b549-4c04-9ce6-a94226c970ca admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.470588 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e0df35f0-b549-4c04-9ce6-a94226c970ca admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6032829'] for subnet, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.550899 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e0df35f0-b549-4c04-9ce6-a94226c970ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.648518 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device fc90a0fd-7ca9-4a92-a265-28ce1dd9160f no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:08:40.670066 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: fc90a0fd-7ca9-4a92-a265-28ce1dd9160f {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:08:40.671626 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e0df35f0-b549-4c04-9ce6-a94226c970ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5898882', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5636066'] for subnet, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.674629 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:40.675346 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device fc90a0fd-7ca9-4a92-a265-28ce1dd9160f not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:08:40.706701 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0df35f0-b549-4c04-9ce6-a94226c970ca admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5d332463-1c62-46e2-a7e3-4b587a2e5f1e,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:40.708868 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e0df35f0-b549-4c04-9ce6-a94226c970ca admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.713466 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-e0df35f0-b549-4c04-9ce6-a94226c970ca admin admin] 10.222.0.41 "DELETE /v2.0/subnets/5d332463-1c62-46e2-a7e3-4b587a2e5f1e HTTP/1.1" status: 204 len: 168 time: 0.3205457 Jun 17 11:08:40.713466 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-e0df35f0-b549-4c04-9ce6-a94226c970ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:40.713836 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 40658) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:40.717544 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e21056ce-5cfc-493a-a33e-0eca564247c3 None None] Network aeced3ed-7670-4043-a385-87de6f75150b requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:08:40.798258 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.849763 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Deleting port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:08:40.850181 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.964981 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] For port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=73e98b86-7c73-4167-b4a8-feb4cf8eeaba,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:40.965342 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:40.971359 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18280dd2-3834-478c-921e-de66258d4a32 None None] DHCP port deletion for aeced3ed-7670-4043-a385-87de6f75150b request from dv-cinder-773870-6-iscsi {{(pid=110216) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Jun 17 11:08:41.025467 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-18280dd2-3834-478c-921e-de66258d4a32 None None] Deleting port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba {{(pid=110216) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:08:41.025854 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-18280dd2-3834-478c-921e-de66258d4a32 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:41.035640 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Calling delete_port for 73e98b86-7c73-4167-b4a8-feb4cf8eeaba owned by network:dhcp {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:08:41.091565 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-18280dd2-3834-478c-921e-de66258d4a32 None None] For port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=73e98b86-7c73-4167-b4a8-feb4cf8eeaba,segment=NetworkSegment(d3fb73d8-1b81-4c52-a6b6-adfd6cce7334),segment_id=d3fb73d8-1b81-4c52-a6b6-adfd6cce7334)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:41.091966 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-18280dd2-3834-478c-921e-de66258d4a32 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:41.111078 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3527aec6-376b-4299-bd02-21e1824c5b3a req-3ac7aeb1-2e1a-4f64-a62a-eec7b2713d79 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:41.112558 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3527aec6-376b-4299-bd02-21e1824c5b3a req-3ac7aeb1-2e1a-4f64-a62a-eec7b2713d79 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 946 time: 0.1884408 Jun 17 11:08:41.157413 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-18280dd2-3834-478c-921e-de66258d4a32 None None] Calling delete_port for 73e98b86-7c73-4167-b4a8-feb4cf8eeaba owned by network:dhcp {{(pid=110216) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:08:41.164418 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3527aec6-376b-4299-bd02-21e1824c5b3a req-18871946-56ba-41a7-98f4-d60ab161935a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441060 Jun 17 11:08:41.244738 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:41.246962 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-4beda069-2baf-495d-b959-001bdea9030b tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:41.252340 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-18280dd2-3834-478c-921e-de66258d4a32 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159'] for port, after_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:41.256513 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:41.271606 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Pushing event deleted for resources: {'Port': ['ID=73e98b86-7c73-4167-b4a8-feb4cf8eeaba,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:41.274690 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:41.275474 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] No DVR routers for this DVR port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba on host dv-cinder-773870-6-iscsi {{(pid=110214) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:08:41.280294 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18280dd2-3834-478c-921e-de66258d4a32 None None] Pushing event deleted for resources: {'Port': ['ID=73e98b86-7c73-4167-b4a8-feb4cf8eeaba,revision_number=None']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:41.282140 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18280dd2-3834-478c-921e-de66258d4a32 None None] No DVR routers for this DVR port 73e98b86-7c73-4167-b4a8-feb4cf8eeaba on host dv-cinder-773870-6-iscsi {{(pid=110216) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:08:41.283581 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-18280dd2-3834-478c-921e-de66258d4a32 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:41.348696 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:41.358220 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aeced3ed-7670-4043-a385-87de6f75150b']}} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:41.368403 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334') {'for_net_delete': True} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:41.368695 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd3fb73d8-1b81-4c52-a6b6-adfd6cce7334') {} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:41.376931 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6228436'] for segment, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:41.389952 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:41.396803 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Releasing vlan 143 on physical network physnet1 to pool {{(pid=110214) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:08:41.397327 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6239464'] for segment, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: Traceback (most recent call last): Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: timer() Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: cb(*args, **kw) Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: return func(*args, **kwargs) Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: self._notify() Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: self.callback(batched_events) Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: event.method(event) Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: return f(self, *a, **k) Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._get(url).json() Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: return self.request(url, 'GET', **kwargs) Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:08:41.399129 dv-cinder-773870-6-iscsi neutron-server[110214]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:08:41.541619 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:41.546321 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:41.549113 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] 10.222.0.41 "DELETE /v2.0/networks/aeced3ed-7670-4043-a385-87de6f75150b HTTP/1.1" status: 204 len: 168 time: 0.8331347 Jun 17 11:08:41.549944 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-072e59ff-eaa0-4180-aa8b-741d5af36789 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:41.552069 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40694) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:41.561826 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Pushing event deleted for resources: {'Network': ['ID=aeced3ed-7670-4043-a385-87de6f75150b,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:41.564400 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:42.161277 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8355326'] for router_interface, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:42.224343 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 2c924c70-c971-4a36-8d58-1335920ceb42 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:08:42.242716 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 2c924c70-c971-4a36-8d58-1335920ceb42 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:08:42.243220 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 2c924c70-c971-4a36-8d58-1335920ceb42 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:08:42.243839 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 73e98b86-7c73-4167-b4a8-feb4cf8eeaba no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:08:42.263515 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 73e98b86-7c73-4167-b4a8-feb4cf8eeaba {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:08:42.263864 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 73e98b86-7c73-4167-b4a8-feb4cf8eeaba not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:08:42.379474 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40b74a7e-8761-4ac6-a355-48b969daa71a req-2565bb32-7be8-49bd-b9e9-dd30be348d52 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:42.381321 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-40b74a7e-8761-4ac6-a355-48b969daa71a req-2565bb32-7be8-49bd-b9e9-dd30be348d52 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 946 time: 0.0726762 Jun 17 11:08:42.421977 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-40b74a7e-8761-4ac6-a355-48b969daa71a req-4c10af49-84c8-4f31-901c-1c478e0c434e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0338573 Jun 17 11:08:42.451263 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Deleting port 68867abb-4eea-4548-9fa0-32ed4c61ef87 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:08:42.451607 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:42.528554 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] For port 68867abb-4eea-4548-9fa0-32ed4c61ef87, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=68867abb-4eea-4548-9fa0-32ed4c61ef87,segment=NetworkSegment(a1ea3154-a16f-407e-87a0-2b5b223e448c),segment_id=a1ea3154-a16f-407e-87a0-2b5b223e448c)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:42.528853 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:42.594353 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Calling delete_port for 68867abb-4eea-4548-9fa0-32ed4c61ef87 owned by network:router_interface {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:08:42.878627 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:42.880859 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:42.904979 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Pushing event deleted for resources: {'Port': ['ID=68867abb-4eea-4548-9fa0-32ed4c61ef87,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:42.908573 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:43.070649 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7899567', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8355178'] for router_interface, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:43.275184 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Router 09c83440-160f-4872-866e-39bee65fe6ab has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:08:43.379928 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:08:43.385162 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] 10.222.0.41 "PUT /v2.0/routers/09c83440-160f-4872-866e-39bee65fe6ab/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8317318 Jun 17 11:08:43.387653 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40704) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:43.388784 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0df601ae-acc0-4c8a-a7bb-b21a19acc54d None None] Sync routers for ids ['09c83440-160f-4872-866e-39bee65fe6ab'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:08:43.398243 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0df601ae-acc0-4c8a-a7bb-b21a19acc54d None None] Routers {'09c83440-160f-4872-866e-39bee65fe6ab'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:08:43.398875 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-0df601ae-acc0-4c8a-a7bb-b21a19acc54d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:08:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['09c83440-160f-4872-866e-39bee65fe6ab'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:43.492325 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Notify callbacks [] for router, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:43.501654 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-0df601ae-acc0-4c8a-a7bb-b21a19acc54d None None] Set router 09c83440-160f-4872-866e-39bee65fe6ab gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:08:43.598008 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:43.613820 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f06e8055-f145-46d2-bbc7-f685bbaa860a req-f9227b31-e7f6-4a0b-83d9-7fd5577171d7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:08:43.615401 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f06e8055-f145-46d2-bbc7-f685bbaa860a req-f9227b31-e7f6-4a0b-83d9-7fd5577171d7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 946 time: 0.0652249 Jun 17 11:08:43.657347 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f06e8055-f145-46d2-bbc7-f685bbaa860a req-a29c89ef-daa5-4485-abcc-238e5d0f3d7c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0361497 Jun 17 11:08:43.676466 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-0df601ae-acc0-4c8a-a7bb-b21a19acc54d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09c83440-160f-4872-866e-39bee65fe6ab', 'name': 'tempest-TestMinimumBasicScenario-428147393-router', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238'}], 'enable_snat': True}, 'gw_port_id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:30Z', 'updated_at': '2021-06-17T11:08:42Z', 'revision_number': 5, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'gw_port': {'id': '78b15da2-1d10-42eb-927c-9b229a7351ae', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:a7:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09c83440-160f-4872-866e-39bee65fe6ab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:03:31Z', 'updated_at': '2021-06-17T11:03:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:43.706247 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0df601ae-acc0-4c8a-a7bb-b21a19acc54d None None] Checking router: 09c83440-160f-4872-866e-39bee65fe6ab for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:08:43.714473 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0df601ae-acc0-4c8a-a7bb-b21a19acc54d None None] Routers {'09c83440-160f-4872-866e-39bee65fe6ab'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:08:43.715549 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-0df601ae-acc0-4c8a-a7bb-b21a19acc54d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:08:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['09c83440-160f-4872-866e-39bee65fe6ab'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:43.730672 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Deleting port 78b15da2-1d10-42eb-927c-9b229a7351ae {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:08:43.731044 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:43.793431 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-0df601ae-acc0-4c8a-a7bb-b21a19acc54d None None] Set router 09c83440-160f-4872-866e-39bee65fe6ab gateway port host: None {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:08:43.810288 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] For port 78b15da2-1d10-42eb-927c-9b229a7351ae, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=78b15da2-1d10-42eb-927c-9b229a7351ae,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:43.810648 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:43.845254 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-0df601ae-acc0-4c8a-a7bb-b21a19acc54d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '09c83440-160f-4872-866e-39bee65fe6ab', 'name': 'tempest-TestMinimumBasicScenario-428147393-router', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:30Z', 'updated_at': '2021-06-17T11:08:43Z', 'revision_number': 6, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'gw_port_host': None}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:43.869785 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0df601ae-acc0-4c8a-a7bb-b21a19acc54d None None] The sync data for ids ['09c83440-160f-4872-866e-39bee65fe6ab'] in dv-cinder-773870-6-iscsi is: [{'id': '09c83440-160f-4872-866e-39bee65fe6ab', 'name': 'tempest-TestMinimumBasicScenario-428147393-router', 'tenant_id': '513dfbb39109406bb7e4ae289b99ad98', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:03:30Z', 'updated_at': '2021-06-17T11:08:43Z', 'revision_number': 6, 'project_id': '513dfbb39109406bb7e4ae289b99ad98', 'gw_port_host': None}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:08:43.872579 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Calling delete_port for 78b15da2-1d10-42eb-927c-9b229a7351ae owned by network:router_gateway {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:08:44.147502 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.150228 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4916079a-7a21-431d-a62a-be397e166c32 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:44.176594 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Pushing event deleted for resources: {'Port': ['ID=78b15da2-1d10-42eb-927c-9b229a7351ae,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:44.178722 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:44.243385 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8286505'] for router_gateway, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.338374 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8357994', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2026'] for router, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.340562 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.401479 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 68867abb-4eea-4548-9fa0-32ed4c61ef87 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:08:44.425605 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 68867abb-4eea-4548-9fa0-32ed4c61ef87 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:08:44.426008 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 68867abb-4eea-4548-9fa0-32ed4c61ef87 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:08:44.456020 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8291427'] for router, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.456528 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Fanout notify agent at l3_agent the message router_deleted on router 09c83440-160f-4872-866e-39bee65fe6ab {{(pid=110215) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Jun 17 11:08:44.461208 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Notify callbacks [] for router, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.462372 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] 10.222.0.41 "DELETE /v2.0/routers/09c83440-160f-4872-866e-39bee65fe6ab HTTP/1.1" status: 204 len: 168 time: 1.0738053 Jun 17 11:08:44.464872 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40712) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:44.514478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_v2 [None req-dbd83585-a3c2-4d32-9168-c31ff93b8dc3 admin admin] Deleting subnet 8a8d9b36-b457-42ac-b365-dc16ef24b559 {{(pid=110215) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:08:44.517660 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-dbd83585-a3c2-4d32-9168-c31ff93b8dc3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.551592 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-dbd83585-a3c2-4d32-9168-c31ff93b8dc3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6032829'] for subnet, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.629812 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-dbd83585-a3c2-4d32-9168-c31ff93b8dc3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.747581 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-dbd83585-a3c2-4d32-9168-c31ff93b8dc3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5898882', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5636066'] for subnet, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.750023 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3fb579a0-554f-4d06-89bc-b799ae5fbdee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:44.779430 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbd83585-a3c2-4d32-9168-c31ff93b8dc3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8a8d9b36-b457-42ac-b365-dc16ef24b559,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:44.781371 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-dbd83585-a3c2-4d32-9168-c31ff93b8dc3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.783393 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-dbd83585-a3c2-4d32-9168-c31ff93b8dc3 admin admin] 10.222.0.41 "DELETE /v2.0/subnets/8a8d9b36-b457-42ac-b365-dc16ef24b559 HTTP/1.1" status: 204 len: 168 time: 0.3175969 Jun 17 11:08:44.784430 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-dbd83585-a3c2-4d32-9168-c31ff93b8dc3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:44.786168 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 40714) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:44.787538 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8ee4167-2faa-464b-9c9d-0278094a4a3a None None] Network d8beeb1f-3611-4a57-a06b-8027d5a36842 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:08:44.854458 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.904651 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Deleting port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:08:44.904907 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:44.958574 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88f57125-5ad0-4a64-a816-845c2aa09674 None None] DHCP port deletion for d8beeb1f-3611-4a57-a06b-8027d5a36842 request from dv-cinder-773870-6-iscsi {{(pid=110216) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Jun 17 11:08:44.966997 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] For port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=9a5c3d03-1d5b-4666-9ca6-b1bd433f5866,segment=NetworkSegment(a1ea3154-a16f-407e-87a0-2b5b223e448c),segment_id=a1ea3154-a16f-407e-87a0-2b5b223e448c)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:44.967358 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.007728 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-88f57125-5ad0-4a64-a816-845c2aa09674 None None] Deleting port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 {{(pid=110216) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:08:45.007728 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-88f57125-5ad0-4a64-a816-845c2aa09674 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.031140 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Calling delete_port for 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 owned by network:dhcp {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:08:45.070494 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-88f57125-5ad0-4a64-a816-845c2aa09674 None None] For port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=9a5c3d03-1d5b-4666-9ca6-b1bd433f5866,segment=NetworkSegment(a1ea3154-a16f-407e-87a0-2b5b223e448c),segment_id=a1ea3154-a16f-407e-87a0-2b5b223e448c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:08:45.070925 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-88f57125-5ad0-4a64-a816-845c2aa09674 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.140292 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-88f57125-5ad0-4a64-a816-845c2aa09674 None None] Calling delete_port for 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 owned by network:dhcp {{(pid=110216) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:08:45.180944 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.183971 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a9967fcd-282d-47e5-a6b7-e5843c7b5f0d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:45.206318 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Pushing event deleted for resources: {'Port': ['ID=9a5c3d03-1d5b-4666-9ca6-b1bd433f5866,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:45.208788 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:45.211176 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] No DVR routers for this DVR port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 on host dv-cinder-773870-6-iscsi {{(pid=110214) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:08:45.216199 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-88f57125-5ad0-4a64-a816-845c2aa09674 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159'] for port, after_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.219191 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:45.244799 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88f57125-5ad0-4a64-a816-845c2aa09674 None None] Pushing event deleted for resources: {'Port': ['ID=9a5c3d03-1d5b-4666-9ca6-b1bd433f5866,revision_number=None']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:45.246627 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88f57125-5ad0-4a64-a816-845c2aa09674 None None] No DVR routers for this DVR port 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 on host dv-cinder-773870-6-iscsi {{(pid=110216) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:08:45.248040 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-88f57125-5ad0-4a64-a816-845c2aa09674 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:45.280907 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.290939 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d8beeb1f-3611-4a57-a06b-8027d5a36842']}} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:45.304147 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a1ea3154-a16f-407e-87a0-2b5b223e448c') {'for_net_delete': True} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:45.304482 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a1ea3154-a16f-407e-87a0-2b5b223e448c') {} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:08:45.313374 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6228436'] for segment, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.326415 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.331965 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Releasing vlan 125 on physical network physnet1 to pool {{(pid=110214) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:08:45.332445 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6239464'] for segment, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: Traceback (most recent call last): Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: timer() Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: cb(*args, **kw) Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: return func(*args, **kwargs) Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: self._notify() Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: self.callback(batched_events) Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: event.method(event) Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: return f(self, *a, **k) Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._get(url).json() Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: return self.request(url, 'GET', **kwargs) Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:08:45.334065 dv-cinder-773870-6-iscsi neutron-server[110214]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:08:45.462172 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.466950 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.471559 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] 10.222.0.41 "DELETE /v2.0/networks/d8beeb1f-3611-4a57-a06b-8027d5a36842 HTTP/1.1" status: 204 len: 168 time: 0.6812308 Jun 17 11:08:45.471559 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:45.482172 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Pushing event deleted for resources: {'Network': ['ID=d8beeb1f-3611-4a57-a06b-8027d5a36842,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:45.484716 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a3d54e69-f311-4df5-b795-4ad42e51bac8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:45.787577 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40720) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:45.825652 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-48fb4737-ab3e-4e52-8809-cbf718786b59 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=ed69cf6aa40941c48c25effb0c1af8fc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0366807 Jun 17 11:08:45.827914 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40722) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:45.873601 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4938ceb7-56e8-4816-aafa-372e514f911c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.894707 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4938ceb7-56e8-4816-aafa-372e514f911c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:45.999054 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4938ceb7-56e8-4816-aafa-372e514f911c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:46.002280 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4938ceb7-56e8-4816-aafa-372e514f911c admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:46.003484 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-4938ceb7-56e8-4816-aafa-372e514f911c admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/d13c205a-f6de-4b53-abc9-1484c3d728be HTTP/1.1" status: 204 len: 168 time: 0.1746111 Jun 17 11:08:46.004377 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:46.012518 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4938ceb7-56e8-4816-aafa-372e514f911c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d13c205a-f6de-4b53-abc9-1484c3d728be,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:46.015082 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4938ceb7-56e8-4816-aafa-372e514f911c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:46.222115 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 78b15da2-1d10-42eb-927c-9b229a7351ae no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:08:46.245482 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 78b15da2-1d10-42eb-927c-9b229a7351ae {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:08:46.245832 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 78b15da2-1d10-42eb-927c-9b229a7351ae not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:08:46.246260 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:08:46.265372 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:08:46.265653 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 9a5c3d03-1d5b-4666-9ca6-b1bd433f5866 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:08:46.710663 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40730) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:46.747175 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-6daf3e40-a93b-4e73-b711-bdda533b12fd admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=513dfbb39109406bb7e4ae289b99ad98&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0367420 Jun 17 11:08:46.749504 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 40732) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:08:46.800443 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-575b83d1-6544-4df2-8ec3-dfa223459ddf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:46.823897 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-575b83d1-6544-4df2-8ec3-dfa223459ddf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:46.959155 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-575b83d1-6544-4df2-8ec3-dfa223459ddf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:46.961752 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-575b83d1-6544-4df2-8ec3-dfa223459ddf admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:46.962895 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-575b83d1-6544-4df2-8ec3-dfa223459ddf admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/722c2ca3-3f5b-4fe9-a9f3-0dcd4755001d HTTP/1.1" status: 204 len: 168 time: 0.2124338 Jun 17 11:08:46.963710 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:08:46.971192 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575b83d1-6544-4df2-8ec3-dfa223459ddf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=722c2ca3-3f5b-4fe9-a9f3-0dcd4755001d,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:08:46.973434 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-575b83d1-6544-4df2-8ec3-dfa223459ddf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:08:50.673559 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-5ecff1a0-ba37-44cb-a16b-fdd4a4dc73fe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:53.376039 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-cd626750-7466-4e5c-9e9c-060c95ad55ec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:53.591580 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:54.467866 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:08:56.862023 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:02.046729 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:09:07.684192 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:20.661900 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-baa29818-e597-467a-8a79-8f9c704036e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:23.335639 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-0f566400-0ed9-4130-9a5a-58dd6ac3beeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:23.608195 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:24.476747 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:26.838274 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:37.683991 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:37.969743 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-a7764dfc-96fc-4866-b4b1-d8e76a027680 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1383576 Jun 17 11:09:38.072147 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-25cb79d2-856a-4f8e-a63c-ce58daa58086 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:09:38.073516 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-25cb79d2-856a-4f8e-a63c-ce58daa58086 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 1099 time: 0.0509181 Jun 17 11:09:38.180126 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-a93a3a8b-9b52-4767-983e-3baf7f13a6d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:09:38.181549 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-a93a3a8b-9b52-4767-983e-3baf7f13a6d4 service neutron] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 918 time: 0.0858698 Jun 17 11:09:38.245080 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-1eff89b6-615b-4f56-8a82-5564d19cc49b service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=787f2fec-2d83-44f5-9283-874e16102ce0 HTTP/1.1" status: 200 len: 1000 time: 0.0554972 Jun 17 11:09:38.295691 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-da68d7f7-a06b-4ccc-b308-1a1ffb30e739 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:09:38.297064 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-da68d7f7-a06b-4ccc-b308-1a1ffb30e739 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0452495 Jun 17 11:09:38.350964 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-e6e9f834-1831-4f93-91dc-e85611cb295c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:09:38.352374 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-e6e9f834-1831-4f93-91dc-e85611cb295c service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0483658 Jun 17 11:09:38.363522 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-8fe8c54f-9ef4-4271-94d5-b2e5495ad06d service neutron] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110215) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 11:09:38.365373 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-8fe8c54f-9ef4-4271-94d5-b2e5495ad06d service neutron] 10.222.0.25 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0050905 Jun 17 11:09:38.449715 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-9156a1ce-16b4-4094-929a-730dbb140f5d service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0778625 Jun 17 11:09:38.541471 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d1c82b85-4d22-423d-9ab2-1b402bdb624a req-ab10a578-ddcd-4da4-bbb8-4bd4eaf600c6 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835090 Jun 17 11:09:39.044871 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:09:50.655408 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-cd67e172-7a8c-4cab-9bfe-d6a97461357c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:53.338508 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-b642c731-e48b-4900-94fb-3ca008ba2417 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:53.586658 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:54.513269 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:09:56.850027 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:06.791294 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65950a86-84f6-46fd-a2e3-a6a40007204b req-d772c04f-de22-4df0-8941-79e1951887a1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:06.792765 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-65950a86-84f6-46fd-a2e3-a6a40007204b req-d772c04f-de22-4df0-8941-79e1951887a1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 946 time: 0.0711160 Jun 17 11:10:06.830006 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-65950a86-84f6-46fd-a2e3-a6a40007204b req-583b1e0b-f996-417e-8c4a-7bcca71ff611 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314682 Jun 17 11:10:07.729025 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:08.008665 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e65e09-ce6a-4aba-8ddc-a62297f1640a req-97448717-d4dc-4c5e-814b-5760455fd863 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:08.010142 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c5e65e09-ce6a-4aba-8ddc-a62297f1640a req-97448717-d4dc-4c5e-814b-5760455fd863 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 946 time: 0.0624590 Jun 17 11:10:08.048216 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c5e65e09-ce6a-4aba-8ddc-a62297f1640a req-8a3ddb7f-b507-460e-96a7-4a837770247a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322826 Jun 17 11:10:08.919831 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-f9dd1c62-dc75-4286-9751-18bc38be7cfc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:08.921212 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-f9dd1c62-dc75-4286-9751-18bc38be7cfc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.25 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 946 time: 0.0623484 Jun 17 11:10:09.027879 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Deleting port 787f2fec-2d83-44f5-9283-874e16102ce0 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:10:09.028224 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:09.114027 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] For port 787f2fec-2d83-44f5-9283-874e16102ce0, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=787f2fec-2d83-44f5-9283-874e16102ce0,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:09.114480 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:09.228188 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38e8ec04-caf7-4f4a-8c85-c4764f242ec5 req-842ed413-45f8-4405-8f32-546b0247abed tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:09.236448 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-38e8ec04-caf7-4f4a-8c85-c4764f242ec5 req-842ed413-45f8-4405-8f32-546b0247abed tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 946 time: 0.0642412 Jun 17 11:10:09.267486 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-38e8ec04-caf7-4f4a-8c85-c4764f242ec5 req-7df98cfc-460a-4041-a5c9-8596e384a58a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=34b639cc-28f8-43be-a66a-93bad39c20f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322173 Jun 17 11:10:09.285329 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:09.285707 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:09.286019 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.l3_db [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Floating IP 8c6b595c-a5db-41e7-b635-7cbfa17d2243 disassociated. External IP: 172.27.3.94, port: 787f2fec-2d83-44f5-9283-874e16102ce0. Jun 17 11:10:09.286379 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Calling delete_port for 787f2fec-2d83-44f5-9283-874e16102ce0 owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:10:09.458722 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:09.462804 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9703ac63-ef3e-4a8c-990d-05b0580589f7 tempest-AttachVolumeNegativeTest-1510298775 tempest-AttachVolumeNegativeTest-1510298775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:09.491651 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event deleted for resources: {'Port': ['ID=787f2fec-2d83-44f5-9283-874e16102ce0,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:09.508097 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.508097 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.508097 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.508097 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.508097 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.508097 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.508097 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.508693 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.508693 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.509029 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.509382 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.509730 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:09.540398 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:09.609835 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Router a0be9488-bc15-4149-b213-8c5540303580 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:10:09.710500 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:10:09.719726 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a98968e2-7385-4939-a554-79c3d594fb7f None None] Sync routers for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:10:09.728440 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a98968e2-7385-4939-a554-79c3d594fb7f None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:09.729128 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-a98968e2-7385-4939-a554-79c3d594fb7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:09:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:09.755679 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] No DVR routers for this DVR port 787f2fec-2d83-44f5-9283-874e16102ce0 on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:10:09.758225 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:09.760249 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-45e2831b-fcd6-4fb3-8680-2d2eb1e10e35 req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.25 "DELETE /v2.0/ports/787f2fec-2d83-44f5-9283-874e16102ce0 HTTP/1.1" status: 204 len: 173 time: 0.8319712 Jun 17 11:10:09.761039 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'name': 'network-vif-deleted', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:10:09.763422 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f607e09-9eaf-497a-b5fc-4a4b3f66512e" -d '{"events": [{"server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "name": "network-vif-deleted", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:10:09.836670 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-a98968e2-7385-4939-a554-79c3d594fb7f None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:09.862493 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:10:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a05aaec1-8992-45ba-907e-ae7251f453f3 x-openstack-request-id: req-a05aaec1-8992-45ba-907e-ae7251f453f3 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:10:09.862925 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c49d302-8c28-401f-b355-26568b700ec5", "name": "network-vif-deleted", "tag": "787f2fec-2d83-44f5-9283-874e16102ce0", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:10:09.863344 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-a05aaec1-8992-45ba-907e-ae7251f453f3 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:10:09.863790 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c49d302-8c28-401f-b355-26568b700ec5', 'name': 'network-vif-deleted', 'tag': '787f2fec-2d83-44f5-9283-874e16102ce0', 'status': 'completed', 'code': 200} Jun 17 11:10:10.175411 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-a98968e2-7385-4939-a554-79c3d594fb7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:10.202095 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a98968e2-7385-4939-a554-79c3d594fb7f None None] Checking router: a0be9488-bc15-4149-b213-8c5540303580 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:10:10.210959 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a98968e2-7385-4939-a554-79c3d594fb7f None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:10.213238 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-a98968e2-7385-4939-a554-79c3d594fb7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:09:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:10.321324 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-a98968e2-7385-4939-a554-79c3d594fb7f None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:10.450231 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3208524e-41c9-4999-8ef4-479626217bfb req-785e6c7f-e65d-41dd-ab40-54ec23b606c1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=5c49d302-8c28-401f-b355-26568b700ec5 HTTP/1.1" status: 200 len: 210 time: 0.0492899 Jun 17 11:10:10.542798 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-a98968e2-7385-4939-a554-79c3d594fb7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:10.573579 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a98968e2-7385-4939-a554-79c3d594fb7f None None] The sync data for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi is: [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:10:10.818310 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e54cc8ce-9d35-4bf2-a5ae-891f0dc9587d None None] New status for floating IP 8c6b595c-a5db-41e7-b635-7cbfa17d2243: DOWN {{(pid=110218) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:10:10.898341 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afe736f7-0586-4291-943a-7a183f798329 req-78564113-e8cc-4d8b-81c4-d48c7d094abd tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:10.899883 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-afe736f7-0586-4291-943a-7a183f798329 req-78564113-e8cc-4d8b-81c4-d48c7d094abd tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 945 time: 0.0671127 Jun 17 11:10:10.939156 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-afe736f7-0586-4291-943a-7a183f798329 req-e476eb20-0171-4f65-a3a1-97e9308d725e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0332654 Jun 17 11:10:11.644574 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41006) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:11.698395 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:11.720920 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:11.844017 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:11.846640 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:11.847835 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "DELETE /v2.0/security-groups/34b639cc-28f8-43be-a66a-93bad39c20f2 HTTP/1.1" status: 204 len: 168 time: 0.2022824 Jun 17 11:10:11.848744 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-ac693558-0ef1-4b6e-8b6a-5fb94398bc87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:11.851107 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41008) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:11.858469 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=34b639cc-28f8-43be-a66a-93bad39c20f2,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:11.866615 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.866978 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.api.v2.resource [None req-61f61529-3d44-4533-a217-4f7facd30ef6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] show failed (client error): The resource could not be found. Jun 17 11:10:11.867094 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.867410 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.867783 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.868153 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.868267 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-61f61529-3d44-4533-a217-4f7facd30ef6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups/34b639cc-28f8-43be-a66a-93bad39c20f2 HTTP/1.1" status: 404 len: 347 time: 0.0159764 Jun 17 11:10:11.868661 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.869036 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.869401 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.869762 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.870129 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.870490 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.870976 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:11.871297 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41010) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:11.874201 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:11.998948 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Deleting port c6fff809-5cf0-4cf2-8f3b-5e0756989555 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:10:11.999288 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:12.103128 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:12.103363 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:12.168825 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Calling delete_port for c6fff809-5cf0-4cf2-8f3b-5e0756989555 owned by network:floatingip {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:10:12.228682 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a96a9e15-28c4-4630-98c8-afdbb8c6752a req-25be1f59-82d7-441e-a695-c78971353321 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:12.230164 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a96a9e15-28c4-4630-98c8-afdbb8c6752a req-25be1f59-82d7-441e-a695-c78971353321 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 945 time: 0.1754472 Jun 17 11:10:12.284214 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a96a9e15-28c4-4630-98c8-afdbb8c6752a req-5180627e-5ee4-4a5a-8560-b2b892a37d57 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475633 Jun 17 11:10:12.438127 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:12.440054 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:12.465048 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event deleted for resources: {'Port': ['ID=c6fff809-5cf0-4cf2-8f3b-5e0756989555,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:12.468537 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:12.541237 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 787f2fec-2d83-44f5-9283-874e16102ce0 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:10:12.562613 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 787f2fec-2d83-44f5-9283-874e16102ce0 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:10:12.563006 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 787f2fec-2d83-44f5-9283-874e16102ce0 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:10:12.812470 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:12.815053 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:12.816159 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "DELETE /v2.0/floatingips/8c6b595c-a5db-41e7-b635-7cbfa17d2243 HTTP/1.1" status: 204 len: 168 time: 0.9439702 Jun 17 11:10:12.840413 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11292296-2759-4167-a108-4da22f8e1997 req-588cf876-fc2c-4b82-baa1-5906598cd02e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:12.841809 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-11292296-2759-4167-a108-4da22f8e1997 req-588cf876-fc2c-4b82-baa1-5906598cd02e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 945 time: 0.0772030 Jun 17 11:10:12.941822 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Deleting port 32ccdb21-38fc-43ce-babf-60a38df225e7 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:10:12.942463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.027921 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] For port 32ccdb21-38fc-43ce-babf-60a38df225e7, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=32ccdb21-38fc-43ce-babf-60a38df225e7,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:13.028274 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.190537 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.190981 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.191274 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.l3_db [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Floating IP 277ae957-e21c-497c-8ffe-d40d1c6418e5 disassociated. External IP: 172.27.3.92, port: 32ccdb21-38fc-43ce-babf-60a38df225e7. Jun 17 11:10:13.191609 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Calling delete_port for 32ccdb21-38fc-43ce-babf-60a38df225e7 owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:10:13.215627 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41018) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:13.314813 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-22d17163-73da-4f1d-bfae-58f6e743e214 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'security_group': {'name': 'tempest-securitygroup--571727473', 'description': 'tempest-description--1436703507'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:13.404564 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.427994 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-63f7b384-049e-4538-8cde-13fda28fd293 req-05c38a19-da21-402d-956d-61bcb0bde082 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 210 time: 0.0344803 Jun 17 11:10:13.428625 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c16797bf-2ea3-469b-846a-ad62fd01c7c5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:13.433595 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-22d17163-73da-4f1d-bfae-58f6e743e214 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.452731 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event deleted for resources: {'Port': ['ID=32ccdb21-38fc-43ce-babf-60a38df225e7,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:13.456465 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:13.523368 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-22d17163-73da-4f1d-bfae-58f6e743e214 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.565935 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:10:13.590061 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-22d17163-73da-4f1d-bfae-58f6e743e214 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.593195 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-45adb132-32ec-44fa-a1c5-1b575b1eaad2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:13.627625 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d17163-73da-4f1d-bfae-58f6e743e214 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f272e923-d002-45f5-b360-fe53bbf06fd6,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:13.631054 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-22d17163-73da-4f1d-bfae-58f6e743e214 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:13.672876 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:10:13.683635 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd0ede52-3d86-4bd5-be03-74889cc08b31 None None] Sync routers for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:10:13.693466 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-22d17163-73da-4f1d-bfae-58f6e743e214 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.694968 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-22d17163-73da-4f1d-bfae-58f6e743e214 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.4796197 Jun 17 11:10:13.697774 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41024) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:13.698534 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd0ede52-3d86-4bd5-be03-74889cc08b31 None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:13.700028 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-bd0ede52-3d86-4bd5-be03-74889cc08b31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:09:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:13.702501 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-8f2da4a9-2316-4fcd-b654-846048de564c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'security_group_rule': {'security_group_id': 'f272e923-d002-45f5-b360-fe53bbf06fd6', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:13.720371 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] No DVR routers for this DVR port 32ccdb21-38fc-43ce-babf-60a38df225e7 on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:10:13.723182 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.725219 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-11292296-2759-4167-a108-4da22f8e1997 req-0b1b576a-36d7-4510-a38a-b1dd5f0b22b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "DELETE /v2.0/ports/32ccdb21-38fc-43ce-babf-60a38df225e7 HTTP/1.1" status: 204 len: 173 time: 0.8775444 Jun 17 11:10:13.725897 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'name': 'network-vif-deleted', 'tag': '32ccdb21-38fc-43ce-babf-60a38df225e7'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:10:13.728303 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf818a71-c63c-43a3-b3d6-05fee9da060c" -d '{"events": [{"server_uuid": "cc31593d-01b6-4451-8ed4-dcacc7dd1852", "name": "network-vif-deleted", "tag": "32ccdb21-38fc-43ce-babf-60a38df225e7"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:10:13.775192 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:10:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-175b0efc-516f-4efb-8915-213713af0dc1 x-openstack-request-id: req-175b0efc-516f-4efb-8915-213713af0dc1 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:10:13.775192 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cc31593d-01b6-4451-8ed4-dcacc7dd1852", "name": "network-vif-deleted", "tag": "32ccdb21-38fc-43ce-babf-60a38df225e7", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:10:13.775192 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-175b0efc-516f-4efb-8915-213713af0dc1 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:10:13.775192 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cc31593d-01b6-4451-8ed4-dcacc7dd1852', 'name': 'network-vif-deleted', 'tag': '32ccdb21-38fc-43ce-babf-60a38df225e7', 'status': 'completed', 'code': 200} Jun 17 11:10:13.786430 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8f2da4a9-2316-4fcd-b654-846048de564c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.831441 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-bd0ede52-3d86-4bd5-be03-74889cc08b31 None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:13.849627 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8f2da4a9-2316-4fcd-b654-846048de564c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.940804 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8f2da4a9-2316-4fcd-b654-846048de564c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:13.943589 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-8b4d758d-43b1-4884-a63b-c38f6412ab46 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:13.959648 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f2da4a9-2316-4fcd-b654-846048de564c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c40c8619-908e-4dd5-8fb2-1bcb8bdcb2c8,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:13.962449 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-8f2da4a9-2316-4fcd-b654-846048de564c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:14.037699 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8f2da4a9-2316-4fcd-b654-846048de564c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:14.038918 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-8f2da4a9-2316-4fcd-b654-846048de564c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3402004 Jun 17 11:10:14.041554 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41030) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:14.050916 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-2a46e774-c560-4aaf-be69-ea0c77787ad9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'security_group_rule': {'security_group_id': 'f272e923-d002-45f5-b360-fe53bbf06fd6', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:14.051042 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-bd0ede52-3d86-4bd5-be03-74889cc08b31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:14.074611 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd0ede52-3d86-4bd5-be03-74889cc08b31 None None] Checking router: 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:10:14.083577 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd0ede52-3d86-4bd5-be03-74889cc08b31 None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:14.084201 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-bd0ede52-3d86-4bd5-be03-74889cc08b31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:09:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:14.132406 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2a46e774-c560-4aaf-be69-ea0c77787ad9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:14.194717 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-bd0ede52-3d86-4bd5-be03-74889cc08b31 None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:14.203567 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2a46e774-c560-4aaf-be69-ea0c77787ad9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:14.271917 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2a46e774-c560-4aaf-be69-ea0c77787ad9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8342537'] for security_group_rule, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:14.274151 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-16adebcd-c65b-443c-8d00-67224c7773ab tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:14.290493 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a46e774-c560-4aaf-be69-ea0c77787ad9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f15a62bd-9241-49fb-b9af-18ad209d047a,revision_number=0']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:14.292924 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2a46e774-c560-4aaf-be69-ea0c77787ad9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:14.374869 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2a46e774-c560-4aaf-be69-ea0c77787ad9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group_rule, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:14.376096 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-2a46e774-c560-4aaf-be69-ea0c77787ad9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3336163 Jun 17 11:10:14.379495 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41032) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:14.385112 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'floatingip': {'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:14.394662 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-bd0ede52-3d86-4bd5-be03-74889cc08b31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:14.423954 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd0ede52-3d86-4bd5-be03-74889cc08b31 None None] The sync data for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi is: [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:10:14.483811 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:14.591562 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fa92724b-1d31-459e-8868-54709d89aa32 req-9463357e-700b-4fe3-a4ee-fc433c86bc8e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=cc31593d-01b6-4451-8ed4-dcacc7dd1852 HTTP/1.1" status: 200 len: 210 time: 0.0351646 Jun 17 11:10:14.601044 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:14.658421 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00ed32ce-1bdb-425a-a59c-168c26c1143e None None] New status for floating IP 277ae957-e21c-497c-8ffe-d40d1c6418e5: DOWN {{(pid=110218) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:10:14.706691 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Allocated IP 172.27.3.106 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/7f48f70b-b11a-4225-b989-644c971f76eb) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:10:14.804220 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:14.932969 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:14.935109 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d0142acd-4827-4125-8a22-1a1473163770 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:14.969744 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:10:14.972581 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:10:14.975973 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:10:15.006349 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'Port': ['ID=7f48f70b-b11a-4225-b989-644c971f76eb,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:15.014497 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:15.077182 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:15.211028 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:15.367611 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:15.431757 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:15.433979 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:15.501481 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'Port': ['ID=7f48f70b-b11a-4225-b989-644c971f76eb,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:15.506080 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:15.514471 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:15.609318 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:15.610618 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.2300277 Jun 17 11:10:15.769101 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-0179ff6d-779d-4205-9d47-e5dba6b1a861 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?name=tempest-securitygroup--571727473&fields=id&tenant_id=e96eb64d17bd425d9b0a15bc07c55136 HTTP/1.1" status: 200 len: 267 time: 0.0360048 Jun 17 11:10:15.889194 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-e3cb5dde-5af6-4fc1-b875-96b1fa0f14ab tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:15.890746 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-e3cb5dde-5af6-4fc1-b875-96b1fa0f14ab tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 817 time: 0.1136467 Jun 17 11:10:15.907609 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-0cd0862f-5baa-4691-84c7-91c146577563 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/quotas/e96eb64d17bd425d9b0a15bc07c55136 HTTP/1.1" status: 200 len: 375 time: 0.0107582 Jun 17 11:10:15.931477 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-051f93a0-611d-40b1-9f04-ee8df1bd83ed tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1961343052&fields=id&tenant_id=a7706f138ac3465ba5820edf148d8153 HTTP/1.1" status: 200 len: 267 time: 0.0576832 Jun 17 11:10:15.989368 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-57ff45fa-8cf6-43e5-8f96-f43a7233f0c4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0751364 Jun 17 11:10:16.035555 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54003e72-c4f1-401e-a151-303c9061929b req-71252e97-0549-40ed-b752-e0518dfb3c67 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:16.037719 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-71252e97-0549-40ed-b752-e0518dfb3c67 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 812 time: 0.1054096 Jun 17 11:10:16.044331 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:10:16.053058 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-cfa171d8-51b3-44ae-8a8a-4d5ca3bd3984 service neutron] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110215) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 11:10:16.053982 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-82656ad1-5aa6-4971-9433-1237f7d32ca0 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/quotas/a7706f138ac3465ba5820edf148d8153 HTTP/1.1" status: 200 len: 375 time: 0.0103185 Jun 17 11:10:16.054379 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-cfa171d8-51b3-44ae-8a8a-4d5ca3bd3984 service neutron] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0521839 Jun 17 11:10:16.130111 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-157c1d9b-e302-4278-a913-2280d768a74b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0697517 Jun 17 11:10:16.152875 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-40a4ea83-4e00-42c2-9578-0f63c12b82ce service neutron] 10.222.0.41 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0926123 Jun 17 11:10:16.204796 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-ed45cddf-e411-4e6e-94b6-f2d3b3e671b5 service neutron] http://10.222.0.41:9696/v2.0/extensions returned with HTTP 200 {{(pid=110214) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Jun 17 11:10:16.206494 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-ed45cddf-e411-4e6e-94b6-f2d3b3e671b5 service neutron] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0614076 Jun 17 11:10:16.256369 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-cb0e4233-e202-4586-9810-d5e02a5d3af3 service neutron] 10.222.0.41 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0977964 Jun 17 11:10:16.305846 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-e0a8ce7b-c7f6-4227-9104-d1547ce6c90d service neutron] 10.222.0.41 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0919688 Jun 17 11:10:16.549035 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 32ccdb21-38fc-43ce-babf-60a38df225e7 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:10:16.585265 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 32ccdb21-38fc-43ce-babf-60a38df225e7 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:10:16.585779 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 32ccdb21-38fc-43ce-babf-60a38df225e7 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:10:16.619415 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-db2a0559-cdc3-46f2-8d19-a98b02044ffb req-5c580f6c-1b20-4b2f-9a1e-7d48c6495e62 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 210 time: 0.0344753 Jun 17 11:10:16.639009 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-94cf8880-f483-4952-9b23-c4a8cd1cef26 service neutron] 10.222.0.41 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3274717 Jun 17 11:10:17.822560 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0d917d38-e838-4231-9e2d-c12897482fcf req-59b17da9-a557-4908-afb2-7a5f2d9c59dc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 210 time: 0.0284894 Jun 17 11:10:18.245764 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c47b163f-4afa-417b-93fe-6a399dd56ffe req-edaed08c-a2c8-4175-8737-834284b51784 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 210 time: 0.0280745 Jun 17 11:10:18.914725 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-802a402a-f640-47ee-a8bf-0439577bbc18 req-39cf07c9-2936-4f31-9428-24ad04e74dbb tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 210 time: 0.0295308 Jun 17 11:10:19.335893 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d877ca4e-2e27-4f09-9099-9a0bac3a266f req-afbd5a6e-5f0c-45bd-90eb-83b51317e02f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 210 time: 0.0332656 Jun 17 11:10:20.006747 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-983310eb-0ade-4268-a823-ef80ca0d97f5 req-d6503954-1478-4c15-b8d9-f980d6ed56a0 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 210 time: 0.0348041 Jun 17 11:10:20.476050 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4379aac5-63cb-49b2-a42e-015f2dfa60c8 req-6c4b9687-30c4-40d5-9fdb-1ca566aecf52 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 210 time: 0.0282249 Jun 17 11:10:20.654840 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9c61f3d3-546b-4b02-a8b5-ab13525ba332 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:21.153920 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54135468-07a8-46ed-a0cd-3a6593695e35 req-fd97a46f-0863-4e8f-ae6d-4f948a55de5b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 210 time: 0.0279152 Jun 17 11:10:21.630683 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d7dea340-b571-40b0-9497-b2ada44da8b5 req-061489c4-7389-4590-905a-e610e658de0b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 210 time: 0.0349615 Jun 17 11:10:22.303022 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ba26aa45-80b9-42a5-af39-1d26784afb17 req-77389b5a-d27c-4c6c-bd1a-166e510ae539 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 210 time: 0.0294492 Jun 17 11:10:22.462879 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb38c41-11f0-44c2-ab90-a08bc7042129 req-7c434b76-a1bd-4286-a73b-9b7784db46d7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:22.464339 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ddb38c41-11f0-44c2-ab90-a08bc7042129 req-7c434b76-a1bd-4286-a73b-9b7784db46d7 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 946 time: 0.0663624 Jun 17 11:10:22.532324 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ddb38c41-11f0-44c2-ab90-a08bc7042129 req-8da13793-9b67-42fc-9214-f77ed72ab3ce tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0621252 Jun 17 11:10:22.599615 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54003e72-c4f1-401e-a151-303c9061929b req-bcbc0183-a67c-441c-addc-f2cf9af03944 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:22.601035 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-bcbc0183-a67c-441c-addc-f2cf9af03944 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 812 time: 0.1147935 Jun 17 11:10:22.650004 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-cc1ab273-9269-4434-a2ae-332d0aee3e4c tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a7706f138ac3465ba5820edf148d8153 HTTP/1.1" status: 200 len: 380 time: 0.0328684 Jun 17 11:10:22.659694 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'port': {'device_id': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'admin_state_up': True, 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'security_groups': ['3b3dcbc2-41c2-439d-a885-9ba22ead5a7e']}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:22.780793 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-369bc960-98ec-462b-832a-b8e68e1b19b4 req-3437954e-9440-4dba-b459-d0a7d970aab8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 210 time: 0.0310123 Jun 17 11:10:22.852342 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Made reservation on behalf of a7706f138ac3465ba5820edf148d8153 for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:10:22.855963 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:22.989762 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Allocated IP 172.20.0.11 (79f5bf09-f965-46d9-8615-13aab136e8eb/1df800fd-de2b-4d27-b603-4af981229332/05c3d654-1803-4edd-9ea3-44a8afd65285) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:10:23.131010 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:23.143805 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Transition to ACTIVE for port object 05c3d654-1803-4edd-9ea3-44a8afd65285 will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:10:23.245760 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:23.256170 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-96d85bf9-0db2-4d73-9ab8-5f2099a08c72 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:23.316093 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Network 79f5bf09-f965-46d9-8615-13aab136e8eb is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:10:23.325753 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:10:23.327878 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'Port': ['ID=05c3d654-1803-4edd-9ea3-44a8afd65285,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:23.337522 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-5b774e1d-9099-426e-a87a-d8fbee494845 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:23.339188 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-5b774e1d-9099-426e-a87a-d8fbee494845 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 817 time: 0.1594255 Jun 17 11:10:23.340036 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:10:23.346654 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-fc0094c2-57df-46a0-950a-d52755b65c67 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:23.366833 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:23.410789 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:23.411613 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:23.433474 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-263817d7-3b18-4393-a45e-a18f85628ceb tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e96eb64d17bd425d9b0a15bc07c55136 HTTP/1.1" status: 200 len: 379 time: 0.0654290 Jun 17 11:10:23.454301 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'port': {'device_id': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'admin_state_up': True, 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'security_groups': ['f272e923-d002-45f5-b360-fe53bbf06fd6']}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:23.476852 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-66239f48-a75a-4b7e-bf23-86617f943117 req-5e87c2af-8c93-4115-9112-02ce3c502e8d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 210 time: 0.0374749 Jun 17 11:10:23.512574 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8564522 Jun 17 11:10:23.550873 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Request body: {'port': {'device_id': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:23.603963 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:23.650282 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:23.757775 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1726c1-bdd2-4e7d-bc62-41a58c797699 req-c2bfffe9-41bf-45c6-b748-a82a519e8f38 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:23.759357 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5c1726c1-bdd2-4e7d-bc62-41a58c797699 req-c2bfffe9-41bf-45c6-b748-a82a519e8f38 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 946 time: 0.0744410 Jun 17 11:10:23.774317 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Made reservation on behalf of e96eb64d17bd425d9b0a15bc07c55136 for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:10:23.777817 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:23.796489 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5c1726c1-bdd2-4e7d-bc62-41a58c797699 req-db339e04-0c5e-49b7-bf80-8794edde2529 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309067 Jun 17 11:10:23.852325 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-cfb00e42-c60a-4650-b8bd-6c47adc4b3da None None] Provisioning for port 05c3d654-1803-4edd-9ea3-44a8afd65285 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:10:23.856570 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-cfb00e42-c60a-4650-b8bd-6c47adc4b3da None None] Provisioning complete for port 05c3d654-1803-4edd-9ea3-44a8afd65285 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:10:23.857063 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-cfb00e42-c60a-4650-b8bd-6c47adc4b3da None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:23.896507 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-cfb00e42-c60a-4650-b8bd-6c47adc4b3da None None] Port 05c3d654-1803-4edd-9ea3-44a8afd65285 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:10:24.038904 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Allocated IP 172.20.0.8 (68556f75-deee-4c64-96a7-37433fd16432/2af00aea-d778-4108-9ac2-b4c1362392ec/bb8e800d-0d92-4757-af24-da32b3db8d82) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:10:24.099341 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30b7586-ca49-4fac-b352-d242ce194551 req-4befb0ab-b9fb-4388-a197-99e2fa491264 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:24.100775 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a30b7586-ca49-4fac-b352-d242ce194551 req-4befb0ab-b9fb-4388-a197-99e2fa491264 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 932 time: 0.1916375 Jun 17 11:10:24.141295 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 05c3d654-1803-4edd-9ea3-44a8afd65285 {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:10:24.160651 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:24.195971 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Transition to ACTIVE for port object 05c3d654-1803-4edd-9ea3-44a8afd65285 will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:10:24.227539 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a30b7586-ca49-4fac-b352-d242ce194551 req-a3dc0266-f930-4cae-9594-a311fba809b9 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1185234 Jun 17 11:10:24.279515 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:24.284543 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7256e1a7-c152-456a-8a95-ed19aed2bed3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:24.289020 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:24.327754 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Transition to ACTIVE for port object bb8e800d-0d92-4757-af24-da32b3db8d82 will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:10:24.388787 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Pushing event updated for resources: {'Port': ['ID=05c3d654-1803-4edd-9ea3-44a8afd65285,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:24.395686 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:24.475503 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Attempting to bind port 05c3d654-1803-4edd-9ea3-44a8afd65285 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:10:24.475832 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Attempting to bind port 05c3d654-1803-4edd-9ea3-44a8afd65285 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:10:24.476221 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Attempting to bind port 05c3d654-1803-4edd-9ea3-44a8afd65285 on network 79f5bf09-f965-46d9-8615-13aab136e8eb {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:10:24.480435 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Port 05c3d654-1803-4edd-9ea3-44a8afd65285 on network 79f5bf09-f965-46d9-8615-13aab136e8eb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:10:24.481085 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Attempting to bind port 05c3d654-1803-4edd-9ea3-44a8afd65285 on network 79f5bf09-f965-46d9-8615-13aab136e8eb {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:10:24.486649 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 10, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:10:24.486934 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Checking segment: {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:10:24.487307 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Bound using segment: {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:10:24.487722 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Bound port: 05c3d654-1803-4edd-9ea3-44a8afd65285, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:10:24.488154 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:24.558220 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:24.558936 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] For port 05c3d654-1803-4edd-9ea3-44a8afd65285, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:10:24.560825 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] For port 05c3d654-1803-4edd-9ea3-44a8afd65285, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=05c3d654-1803-4edd-9ea3-44a8afd65285,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:10:24.601478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:24.605494 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-e23fe204-9172-4294-971c-ca43356525af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:24.649285 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Network 68556f75-deee-4c64-96a7-37433fd16432 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:10:24.652444 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:10:24.658314 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:10:24.663068 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c00edb2-2cfb-42b9-8c67-c082bdfe1041 req-05b5fb18-66b4-43b7-b736-4cf622a04984 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:24.664814 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4c00edb2-2cfb-42b9-8c67-c082bdfe1041 req-05b5fb18-66b4-43b7-b736-4cf622a04984 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 931 time: 0.0650418 Jun 17 11:10:24.668733 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event updated for resources: {'Port': ['ID=bb8e800d-0d92-4757-af24-da32b3db8d82,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:24.672774 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:24.674539 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:24.701693 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-384416e9-877a-4b40-adad-229b219a5b30 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:24.710481 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4c00edb2-2cfb-42b9-8c67-c082bdfe1041 req-0098a199-10c9-415d-a296-d277dfe9e204 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378857 Jun 17 11:10:24.750903 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:24.751753 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:24.752883 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] 10.222.0.25 "PUT /v2.0/ports/05c3d654-1803-4edd-9ea3-44a8afd65285 HTTP/1.1" status: 200 len: 1094 time: 1.2064891 Jun 17 11:10:24.753413 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'tag': '05c3d654-1803-4edd-9ea3-44a8afd65285'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:10:24.755778 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ca557739-7605-40fd-95d3-49de10c086d4" -d '{"events": [{"name": "network-changed", "server_uuid": "ea22557b-cbc7-47a3-9ae1-915b71aefe0b", "tag": "05c3d654-1803-4edd-9ea3-44a8afd65285"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:10:24.766626 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:24.767235 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:24.795766 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Pushing event updated for resources: {'Port': ['ID=05c3d654-1803-4edd-9ea3-44a8afd65285,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:24.799715 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:24.811584 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:10:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-89758a42-195a-4848-8b04-6f2af992cec9 x-openstack-request-id: req-89758a42-195a-4848-8b04-6f2af992cec9 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:10:24.817675 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ea22557b-cbc7-47a3-9ae1-915b71aefe0b", "tag": "05c3d654-1803-4edd-9ea3-44a8afd65285", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:10:24.817675 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-89758a42-195a-4848-8b04-6f2af992cec9 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:10:24.817675 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'tag': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'status': 'completed', 'code': 200} Jun 17 11:10:24.878247 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4288790 Jun 17 11:10:24.889925 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Request body: {'port': {'device_id': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:24.936263 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca557739-7605-40fd-95d3-49de10c086d4 req-1de62c0e-820b-4bb8-9a14-6f727ae2bed0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:24.937681 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ca557739-7605-40fd-95d3-49de10c086d4 req-1de62c0e-820b-4bb8-9a14-6f727ae2bed0 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 1097 time: 0.0998485 Jun 17 11:10:25.005824 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:25.008297 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8acf22f1-c175-443b-b671-9f21424588d2 req-f6ece090-edb8-4d61-be05-8054162b6aea tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:25.009950 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8acf22f1-c175-443b-b671-9f21424588d2 req-f6ece090-edb8-4d61-be05-8054162b6aea tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 946 time: 0.0857775 Jun 17 11:10:25.023730 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-45bd8a90-3ae2-4642-8f00-4711466096e5 None None] Provisioning for port bb8e800d-0d92-4757-af24-da32b3db8d82 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:10:25.027677 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-45bd8a90-3ae2-4642-8f00-4711466096e5 None None] Provisioning complete for port bb8e800d-0d92-4757-af24-da32b3db8d82 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:10:25.028233 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-45bd8a90-3ae2-4642-8f00-4711466096e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:25.051145 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8acf22f1-c175-443b-b671-9f21424588d2 req-57bfea2d-a116-45c1-a820-55a9068dd53d tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups?id=47d46c40-fb66-47dc-8e4e-ffc58b584d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0350575 Jun 17 11:10:25.072900 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-45bd8a90-3ae2-4642-8f00-4711466096e5 None None] Port bb8e800d-0d92-4757-af24-da32b3db8d82 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:10:25.111436 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca557739-7605-40fd-95d3-49de10c086d4 req-77a5cd96-cbf6-44bf-bf37-cec7e449d5e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:25.112912 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ca557739-7605-40fd-95d3-49de10c086d4 req-77a5cd96-cbf6-44bf-bf37-cec7e449d5e5 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=a7706f138ac3465ba5820edf148d8153&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1523871 Jun 17 11:10:25.117900 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-b138d9bf-2b8b-43c6-98a9-4e7ea5f40b0e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:25.119381 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-b138d9bf-2b8b-43c6-98a9-4e7ea5f40b0e tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.25 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 946 time: 0.0670741 Jun 17 11:10:25.222001 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Deleting port de252d43-b5e2-49ef-8e0c-6b09c062aff6 {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:10:25.222356 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:25.315076 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] For port de252d43-b5e2-49ef-8e0c-6b09c062aff6, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=de252d43-b5e2-49ef-8e0c-6b09c062aff6,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:25.315358 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:25.534767 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:25.535191 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:25.535470 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.l3_db [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Floating IP 986d4b31-0924-4404-a37a-0b55a5f9e176 disassociated. External IP: 172.27.3.158, port: de252d43-b5e2-49ef-8e0c-6b09c062aff6. Jun 17 11:10:25.535810 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Calling delete_port for de252d43-b5e2-49ef-8e0c-6b09c062aff6 owned by compute:nova {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:10:25.618555 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca557739-7605-40fd-95d3-49de10c086d4 req-3bd2710a-ccca-4599-a28b-00ea74ba23de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:25.621485 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ca557739-7605-40fd-95d3-49de10c086d4 req-3bd2710a-ccca-4599-a28b-00ea74ba23de service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5002546 Jun 17 11:10:25.651032 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf1172e8-6af0-46b5-8a5a-7cfd6720fded req-ed3ac275-5930-41f4-8500-dc6b51a1d537 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:25.652512 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bf1172e8-6af0-46b5-8a5a-7cfd6720fded req-ed3ac275-5930-41f4-8500-dc6b51a1d537 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 944 time: 0.1816909 Jun 17 11:10:25.741528 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:25.750043 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:25.751273 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bf1172e8-6af0-46b5-8a5a-7cfd6720fded req-d394a83c-86b0-4b3e-a331-51f520180f1a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0929403 Jun 17 11:10:25.795810 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event deleted for resources: {'Port': ['ID=de252d43-b5e2-49ef-8e0c-6b09c062aff6,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:25.799531 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bb8e800d-0d92-4757-af24-da32b3db8d82 {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:10:25.801081 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:25.805889 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54003e72-c4f1-401e-a151-303c9061929b req-66d660ac-eab3-43ec-b8be-eba2ed64e616 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:25.807410 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-66d660ac-eab3-43ec-b8be-eba2ed64e616 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 1097 time: 0.1383402 Jun 17 11:10:25.811262 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:25.858234 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-e75037e2-aca0-492e-9ca2-5aa8021f2010 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=05c3d654-1803-4edd-9ea3-44a8afd65285 HTTP/1.1" status: 200 len: 217 time: 0.0410514 Jun 17 11:10:25.859138 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Transition to ACTIVE for port object bb8e800d-0d92-4757-af24-da32b3db8d82 will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:10:25.908123 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54003e72-c4f1-401e-a151-303c9061929b req-5535a3a6-2784-4b4e-b133-7f2eb52f144b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:25.909451 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-5535a3a6-2784-4b4e-b133-7f2eb52f144b service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0444036 Jun 17 11:10:25.924562 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:25.946789 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-1fb30134-74e0-4c60-b09a-f04c3d663487 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:25.994875 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7210a20c-5d0c-4d72-93a3-2f6e8ff08e65 req-5da4d6ba-e122-49c0-90f2-a3adf4374dc1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:25.997653 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7210a20c-5d0c-4d72-93a3-2f6e8ff08e65 req-5da4d6ba-e122-49c0-90f2-a3adf4374dc1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 931 time: 0.0948749 Jun 17 11:10:25.998275 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Router a17f3ab0-fe2c-4834-806d-28b3794b6366 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:10:26.025254 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Pushing event updated for resources: {'Port': ['ID=bb8e800d-0d92-4757-af24-da32b3db8d82,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:26.030550 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:26.093998 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54003e72-c4f1-401e-a151-303c9061929b req-a24c3cea-9347-46ca-a368-87dd87639b33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:26.095701 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-a24c3cea-9347-46ca-a368-87dd87639b33 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1795866 Jun 17 11:10:26.135266 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7210a20c-5d0c-4d72-93a3-2f6e8ff08e65 req-4743475d-df4e-44b6-84a4-3f3a101c86b3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1226540 Jun 17 11:10:26.145999 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Attempting to bind port bb8e800d-0d92-4757-af24-da32b3db8d82 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:10:26.146469 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Attempting to bind port bb8e800d-0d92-4757-af24-da32b3db8d82 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:10:26.146931 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Attempting to bind port bb8e800d-0d92-4757-af24-da32b3db8d82 on network 68556f75-deee-4c64-96a7-37433fd16432 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:10:26.158427 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Port bb8e800d-0d92-4757-af24-da32b3db8d82 on network 68556f75-deee-4c64-96a7-37433fd16432 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:10:26.158809 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Attempting to bind port bb8e800d-0d92-4757-af24-da32b3db8d82 on network 68556f75-deee-4c64-96a7-37433fd16432 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:10:26.168463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 10, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:10:26.168949 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Checking segment: {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:10:26.169438 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Bound using segment: {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:10:26.169977 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Bound port: bb8e800d-0d92-4757-af24-da32b3db8d82, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a39bef7f-0015-4ba7-8bea-9565729cbb43', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '68556f75-deee-4c64-96a7-37433fd16432'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:10:26.170937 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:26.183167 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:10:26.198786 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9215df27-38a7-4d6c-8bd4-94a71435568f None None] Sync routers for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:10:26.213576 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9215df27-38a7-4d6c-8bd4-94a71435568f None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:26.214483 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-9215df27-38a7-4d6c-8bd4-94a71435568f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:10:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:26.274083 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] No DVR routers for this DVR port de252d43-b5e2-49ef-8e0c-6b09c062aff6 on host hv-cinder-77387 {{(pid=110214) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:10:26.276716 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:26.278687 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-49f85aa8-b1a5-4407-a47d-1184f0979e72 req-70068b4a-b8bf-4510-a1af-f1025d792226 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.25 "DELETE /v2.0/ports/de252d43-b5e2-49ef-8e0c-6b09c062aff6 HTTP/1.1" status: 204 len: 173 time: 1.1542001 Jun 17 11:10:26.279260 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'name': 'network-vif-deleted', 'tag': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6'}] {{(pid=110214) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:10:26.281637 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cc2cf72888dbbd14a3b8c118b05d43e907687f619eecab2abc2da29781eba8b9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e6952c8-e958-4509-86d4-538ce9455db3" -d '{"events": [{"server_uuid": "83aa8649-9e05-4730-8b11-e8ee2387d111", "name": "network-vif-deleted", "tag": "de252d43-b5e2-49ef-8e0c-6b09c062aff6"}]}' {{(pid=110214) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:10:26.331469 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-48b2fa6d-dff9-49fd-9323-0a9a4000d239 req-f55c5323-bdb5-4400-9871-8094b38541ec tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 210 time: 0.0474977 Jun 17 11:10:26.350351 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-f3b6c395-17e7-41d3-8695-e2b4511ef3ff service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2443030 Jun 17 11:10:26.373937 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:10:26.407769 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:10:26.410422 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:10:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e69b566d-369d-4887-b405-dc0447917610 x-openstack-request-id: req-e69b566d-369d-4887-b405-dc0447917610 {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:10:26.411008 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "83aa8649-9e05-4730-8b11-e8ee2387d111", "name": "network-vif-deleted", "tag": "de252d43-b5e2-49ef-8e0c-6b09c062aff6", "status": "completed", "code": 200}]} {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:10:26.416820 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-e69b566d-369d-4887-b405-dc0447917610 {{(pid=110214) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:10:26.416820 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '83aa8649-9e05-4730-8b11-e8ee2387d111', 'name': 'network-vif-deleted', 'tag': 'de252d43-b5e2-49ef-8e0c-6b09c062aff6', 'status': 'completed', 'code': 200} Jun 17 11:10:26.418598 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-9215df27-38a7-4d6c-8bd4-94a71435568f None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:26.475511 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-54003e72-c4f1-401e-a151-303c9061929b req-f610bfe5-4b10-493f-8939-2b0e2dbf6a27 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1111944 Jun 17 11:10:26.507128 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:26.509586 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a94ad1b2-a456-4511-b59b-997ffb97ac2a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:26.545981 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:26.546593 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:26.547965 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] 10.222.0.25 "PUT /v2.0/ports/bb8e800d-0d92-4757-af24-da32b3db8d82 HTTP/1.1" status: 200 len: 1093 time: 1.6626921 Jun 17 11:10:26.568477 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Pushing event updated for resources: {'Port': ['ID=bb8e800d-0d92-4757-af24-da32b3db8d82,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:26.571764 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:26.640266 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-9215df27-38a7-4d6c-8bd4-94a71435568f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:26.668553 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9215df27-38a7-4d6c-8bd4-94a71435568f None None] Checking router: a17f3ab0-fe2c-4834-806d-28b3794b6366 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:10:26.675849 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9215df27-38a7-4d6c-8bd4-94a71435568f None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:26.677142 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-9215df27-38a7-4d6c-8bd4-94a71435568f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:10:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:26.766455 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c874051a-02c4-45a1-b025-539e67d4f1d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:26.767963 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-c874051a-02c4-45a1-b025-539e67d4f1d1 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 1096 time: 0.0587473 Jun 17 11:10:26.807202 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-9215df27-38a7-4d6c-8bd4-94a71435568f None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:26.815546 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:10:26.818482 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b" -d '{"events": [{"name": "network-changed", "server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:10:26.822362 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-2b3c14cc-f555-428f-92f7-8deb9fb6da10 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=bb8e800d-0d92-4757-af24-da32b3db8d82 HTTP/1.1" status: 200 len: 217 time: 0.0446119 Jun 17 11:10:26.866170 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:10:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-83766a14-b1e7-4b90-a8cf-02e13a742074 x-openstack-request-id: req-83766a14-b1e7-4b90-a8cf-02e13a742074 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:10:26.866510 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:10:26.866805 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-83766a14-b1e7-4b90-a8cf-02e13a742074 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:10:26.867260 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'status': 'completed', 'code': 200} Jun 17 11:10:26.881987 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:26.886413 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-d22144af-3218-47c3-b48a-c2efeb41681b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:26.888042 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-d22144af-3218-47c3-b48a-c2efeb41681b service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0543368 Jun 17 11:10:26.954046 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-cf40b610-5276-4a30-bbc9-70a6d07cf0e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:26.955486 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-cf40b610-5276-4a30-bbc9-70a6d07cf0e0 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0598297 Jun 17 11:10:26.983292 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632587b1-a30b-4004-be68-a45c0d48b300 req-97ae37e8-6101-4146-bd9c-5308c2962fb2 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:26.984919 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-632587b1-a30b-4004-be68-a45c0d48b300 req-97ae37e8-6101-4146-bd9c-5308c2962fb2 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 944 time: 0.0675583 Jun 17 11:10:27.026818 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-9215df27-38a7-4d6c-8bd4-94a71435568f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:27.034945 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-632587b1-a30b-4004-be68-a45c0d48b300 req-3b81589c-d81f-4ee4-8422-0e95a062daba tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413635 Jun 17 11:10:27.057171 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-5c04a20f-29d2-4fce-bcbb-2e79d8eee1a6 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0944374 Jun 17 11:10:27.059007 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9215df27-38a7-4d6c-8bd4-94a71435568f None None] The sync data for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi is: [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T10:59:18Z', 'revision_number': 4, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': 'a33b3689-e1bb-4011-a6d6-f16dff180486', 'name': '', 'network_id': '54973ccd-0b2b-4517-ad28-76a3128a2da3', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'mac_address': 'fa:16:3e:0c:e9:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:17Z', 'updated_at': '2021-06-17T10:59:24Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'subnets': [{'id': 'b70c69a2-cf24-49e5-90dd-a210bd42e6bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:10:27.161884 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a01ac32b-11c8-4f88-948e-a9ff6d81d5ac req-1dd9bbc7-51ec-421c-846c-723f1cba66fb service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0969422 Jun 17 11:10:27.295948 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-333cc992-0800-4409-9a63-6d177016ccc6 None None] New status for floating IP 986d4b31-0924-4404-a37a-0b55a5f9e176: DOWN {{(pid=110218) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:10:27.360967 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f021f65-ad31-48bf-8889-82e4d20f82ec req-947330ce-d323-42b6-83a9-6273a2497ca3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:27.365850 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9f021f65-ad31-48bf-8889-82e4d20f82ec req-947330ce-d323-42b6-83a9-6273a2497ca3 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.1015899 Jun 17 11:10:27.415498 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9f021f65-ad31-48bf-8889-82e4d20f82ec req-9b938aa5-661f-4aa0-b0e7-65aa809f16f5 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473444 Jun 17 11:10:27.434582 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b req-da197c2d-f75b-46ca-8b0d-0e95980f0ab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:27.436401 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b req-da197c2d-f75b-46ca-8b0d-0e95980f0ab2 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 1096 time: 0.1211565 Jun 17 11:10:27.520302 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b9b180f6-b56a-4883-938b-8d6d947012d0 req-b008220b-6796-4039-94fb-47ccd5af63f1 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/ports?device_id=83aa8649-9e05-4730-8b11-e8ee2387d111 HTTP/1.1" status: 200 len: 210 time: 0.0321012 Jun 17 11:10:27.536252 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b req-7c602c04-9182-4f5c-a626-282439ca1722 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:27.537476 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b req-7c602c04-9182-4f5c-a626-282439ca1722 service neutron] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 918 time: 0.0938265 Jun 17 11:10:27.586216 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b req-19c048ec-1b01-4388-983e-d7b7e5438f14 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=bb8e800d-0d92-4757-af24-da32b3db8d82 HTTP/1.1" status: 200 len: 217 time: 0.0412021 Jun 17 11:10:27.633648 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b req-2b9786de-e1eb-4123-82a1-6f876c092fe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:27.635066 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b req-2b9786de-e1eb-4123-82a1-6f876c092fe8 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0424314 Jun 17 11:10:27.695872 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b req-6aa7a680-2237-4d97-881e-016a4fd51787 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:27.697377 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b req-6aa7a680-2237-4d97-881e-016a4fd51787 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0528750 Jun 17 11:10:27.792017 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b req-7e1ae40a-ba72-4836-ace1-5de905d9c6e3 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863490 Jun 17 11:10:27.878368 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a8c11fe8-c5c6-48da-b50e-2de79a32c32b req-b3698e20-009b-4a50-a10d-ae33dd410c3e service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798345 Jun 17 11:10:28.217405 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ea48be6-de57-429c-9269-91d21646b505 req-1e6ffae9-c33b-45b7-88c8-fb6c3f536a9b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:28.218871 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1ea48be6-de57-429c-9269-91d21646b505 req-1e6ffae9-c33b-45b7-88c8-fb6c3f536a9b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 944 time: 0.0651145 Jun 17 11:10:28.256351 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1ea48be6-de57-429c-9269-91d21646b505 req-0359fea9-2e35-4c7f-beba-8fdf9ecffd71 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309942 Jun 17 11:10:28.590784 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaa4b88e-51ab-4cab-9e45-1f2b58345f6e req-f348515d-dfc4-455f-80e9-da4cff0b54b1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:28.592279 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-eaa4b88e-51ab-4cab-9e45-1f2b58345f6e req-f348515d-dfc4-455f-80e9-da4cff0b54b1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0626814 Jun 17 11:10:28.629873 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-eaa4b88e-51ab-4cab-9e45-1f2b58345f6e req-deaee48a-5638-4b00-931a-54e6395aeccc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0319078 Jun 17 11:10:28.663882 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device de252d43-b5e2-49ef-8e0c-6b09c062aff6 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:10:28.684696 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: de252d43-b5e2-49ef-8e0c-6b09c062aff6 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:10:28.685060 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device de252d43-b5e2-49ef-8e0c-6b09c062aff6 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:10:28.693526 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41224) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:28.746423 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4a6e6546-6e96-41ba-89f5-645823e3e5e9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:28.768374 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4a6e6546-6e96-41ba-89f5-645823e3e5e9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:28.886827 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4a6e6546-6e96-41ba-89f5-645823e3e5e9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:28.889508 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-4a6e6546-6e96-41ba-89f5-645823e3e5e9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:28.890639 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-4a6e6546-6e96-41ba-89f5-645823e3e5e9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "DELETE /v2.0/security-groups/47d46c40-fb66-47dc-8e4e-ffc58b584d3e HTTP/1.1" status: 204 len: 168 time: 0.1961050 Jun 17 11:10:28.891528 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ab1d4a7f-ad6f-4183-af91-dce1ee539379 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:28.893375 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41226) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:28.900822 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a6e6546-6e96-41ba-89f5-645823e3e5e9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=47d46c40-fb66-47dc-8e4e-ffc58b584d3e,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:28.903143 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4a6e6546-6e96-41ba-89f5-645823e3e5e9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:28.907509 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.api.v2.resource [None req-e92d2dcd-7d4d-470b-b623-48000341f3ac tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] show failed (client error): The resource could not be found. Jun 17 11:10:28.908526 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-e92d2dcd-7d4d-470b-b623-48000341f3ac tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "GET /v2.0/security-groups/47d46c40-fb66-47dc-8e4e-ffc58b584d3e HTTP/1.1" status: 404 len: 347 time: 0.0140791 Jun 17 11:10:28.911981 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41228) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:29.030670 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Deleting port d6400ff8-ec69-4cfa-8c76-5383c42c39be {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:10:29.030991 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:29.104975 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:29.105292 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:29.171512 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Calling delete_port for d6400ff8-ec69-4cfa-8c76-5383c42c39be owned by network:floatingip {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:10:29.364647 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:29.368088 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cf1e2d05-d89f-4b31-8b42-47795ec4731e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:29.396204 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Pushing event deleted for resources: {'Port': ['ID=d6400ff8-ec69-4cfa-8c76-5383c42c39be,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:29.401404 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:29.428368 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f282b3-19a8-4bb0-bc74-8ece05655af3 req-95d79fa7-0045-404d-ae61-9a99b5eb391a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:29.429839 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-38f282b3-19a8-4bb0-bc74-8ece05655af3 req-95d79fa7-0045-404d-ae61-9a99b5eb391a tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 944 time: 0.0660071 Jun 17 11:10:29.456864 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks [] for floatingip, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:29.460015 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:29.461144 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] 10.222.0.41 "DELETE /v2.0/floatingips/986d4b31-0924-4404-a37a-0b55a5f9e176 HTTP/1.1" status: 204 len: 168 time: 0.5481324 Jun 17 11:10:29.477246 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-38f282b3-19a8-4bb0-bc74-8ece05655af3 req-c21fa8ee-e029-42d0-a01d-0cb6ad03b071 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415869 Jun 17 11:10:29.810145 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-839e4145-a63d-4565-9d35-bf8da3812cf2 req-de398157-053f-4b02-a733-e1edb18e861e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:29.811610 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-839e4145-a63d-4565-9d35-bf8da3812cf2 req-de398157-053f-4b02-a733-e1edb18e861e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0631578 Jun 17 11:10:29.847762 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-839e4145-a63d-4565-9d35-bf8da3812cf2 req-7b4cb8a6-5f89-494a-aa16-4c83ec94b58a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0305493 Jun 17 11:10:30.645079 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66ede66-b22c-4080-a12e-5d0576bffc76 req-bbdbb29e-4031-4e18-bacf-3850df336448 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:30.646540 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d66ede66-b22c-4080-a12e-5d0576bffc76 req-bbdbb29e-4031-4e18-bacf-3850df336448 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 944 time: 0.0627065 Jun 17 11:10:30.665190 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device bb8e800d-0d92-4757-af24-da32b3db8d82 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:10:30.685445 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d66ede66-b22c-4080-a12e-5d0576bffc76 req-8eca22fb-9eca-4e90-968a-45941be51d37 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0332482 Jun 17 11:10:30.886656 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:30.898322 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'port_id': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'mac_address': 'fa:16:3e:b3:98:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:10:30.935616 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:30.948109 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bb8e800d-0d92-4757-af24-da32b3db8d82 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:10:30.967739 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:31.035106 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4777047-17c3-4582-8b58-469a10d83bcf req-25b13065-3546-42cf-821b-92775dc64660 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:31.037273 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c4777047-17c3-4582-8b58-469a10d83bcf req-25b13065-3546-42cf-821b-92775dc64660 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0754104 Jun 17 11:10:31.073969 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c4777047-17c3-4582-8b58-469a10d83bcf req-ab00204c-9144-4740-b3d0-784a7b610a92 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309577 Jun 17 11:10:31.078584 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:31.082042 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-6d47e5c3-6f9b-4739-b44b-f2a1f33a2583 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:31.129587 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=bb8e800d-0d92-4757-af24-da32b3db8d82,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:31.136678 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.137038 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.137388 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.137725 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.138061 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.138392 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.138720 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.139077 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.139407 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.139732 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.140059 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.140382 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:10:31.144107 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:31.527191 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['bb8e800d-0d92-4757-af24-da32b3db8d82'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:10:31.861917 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d6bd1aa-830f-44a2-a8ad-71973afea6d6 req-be8d3ff6-2f6f-4c19-bf05-3ec5b8dd575c tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:31.863381 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3d6bd1aa-830f-44a2-a8ad-71973afea6d6 req-be8d3ff6-2f6f-4c19-bf05-3ec5b8dd575c tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 944 time: 0.0653214 Jun 17 11:10:31.900484 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3d6bd1aa-830f-44a2-a8ad-71973afea6d6 req-86563818-e217-4460-a92e-f2e368d247ba tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308478 Jun 17 11:10:32.264707 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a53a22-2ab2-49b3-bfc5-336711d15137 req-ac306459-85b4-4a62-bfdb-90fba6de8b81 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:32.266147 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-45a53a22-2ab2-49b3-bfc5-336711d15137 req-ac306459-85b4-4a62-bfdb-90fba6de8b81 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 944 time: 0.0678780 Jun 17 11:10:32.303945 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-45a53a22-2ab2-49b3-bfc5-336711d15137 req-9bd7a9df-075d-4214-9da1-e60adf077ddf tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0320678 Jun 17 11:10:32.676084 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device bb8e800d-0d92-4757-af24-da32b3db8d82 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:10:32.800926 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port bb8e800d-0d92-4757-af24-da32b3db8d82 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:10:32.805254 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port bb8e800d-0d92-4757-af24-da32b3db8d82 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:10:32.808627 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:32.882486 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:32.904433 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:10:32.906680 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e25269f2-9f2a-479b-a5b6-7152e04c65a4" -d '{"events": [{"server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "name": "network-vif-plugged", "status": "completed", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:10:32.920517 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:32.991635 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:32.994985 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-cd317c5e-bf11-4954-b1fa-27e2f685bcc0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:33.029359 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:10:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82571ebf-671c-4d45-b930-c7b536850a8b x-openstack-request-id: req-82571ebf-671c-4d45-b930-c7b536850a8b {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:10:33.029799 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "name": "network-vif-plugged", "status": "completed", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:10:33.030190 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-82571ebf-671c-4d45-b930-c7b536850a8b {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:10:33.030772 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'code': 200} Jun 17 11:10:33.068431 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=bb8e800d-0d92-4757-af24-da32b3db8d82,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:33.071903 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:33.086114 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e94c0e-e53a-481c-9e99-47a1ca480e35 req-2e09960e-0678-4558-b247-dded3bf3c979 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:33.087622 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a0e94c0e-e53a-481c-9e99-47a1ca480e35 req-2e09960e-0678-4558-b247-dded3bf3c979 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 944 time: 0.0652232 Jun 17 11:10:33.126903 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a0e94c0e-e53a-481c-9e99-47a1ca480e35 req-47ed6020-86d2-4260-a40d-98a3c331cf09 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0328467 Jun 17 11:10:33.465909 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c13102df-8ef2-476e-8f54-69e9af10f01f req-2e26eda0-4b48-450b-a01b-8b8ad353de4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:33.467432 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c13102df-8ef2-476e-8f54-69e9af10f01f req-2e26eda0-4b48-450b-a01b-8b8ad353de4d service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 1098 time: 0.0941527 Jun 17 11:10:33.522170 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50a415df-35a5-46fb-b6e0-4407814c1a26 req-97b202dd-147d-42e2-9977-e47e2bd0da1a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:33.523667 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-50a415df-35a5-46fb-b6e0-4407814c1a26 req-97b202dd-147d-42e2-9977-e47e2bd0da1a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0973520 Jun 17 11:10:33.527998 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c13102df-8ef2-476e-8f54-69e9af10f01f req-5f63d6a9-2bac-4496-b500-c7458453c03a service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0522583 Jun 17 11:10:33.570509 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-50a415df-35a5-46fb-b6e0-4407814c1a26 req-b0442d82-ea4e-4f66-8dcf-432b189877e8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0375037 Jun 17 11:10:33.612029 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41276) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:34.043328 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8355326'] for router_interface, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:34.337268 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15835b37-5f47-4755-9853-43a9a4644e94 req-0800b847-d2d6-4047-8bc7-39a9fb5929bb tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:34.338604 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-15835b37-5f47-4755-9853-43a9a4644e94 req-0800b847-d2d6-4047-8bc7-39a9fb5929bb tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 944 time: 0.0973387 Jun 17 11:10:34.636972 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] Deleting port a33b3689-e1bb-4011-a6d6-f16dff180486 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:10:34.637676 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:34.685851 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-15835b37-5f47-4755-9853-43a9a4644e94 req-953be363-12b5-4f00-9053-5a3c0e43cce6 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3407962 Jun 17 11:10:34.738480 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] For port a33b3689-e1bb-4011-a6d6-f16dff180486, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=a33b3689-e1bb-4011-a6d6-f16dff180486,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:34.739082 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:34.765872 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09eef752-c714-49f1-934d-94f690c6327d req-bd283811-89ca-4adf-afc3-60b86a6f6e39 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:34.768060 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-09eef752-c714-49f1-934d-94f690c6327d req-bd283811-89ca-4adf-afc3-60b86a6f6e39 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0676687 Jun 17 11:10:34.809820 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-09eef752-c714-49f1-934d-94f690c6327d req-0a5b0686-8b6a-4cfe-9e9a-beae488e4a51 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0327966 Jun 17 11:10:34.816182 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] Calling delete_port for a33b3689-e1bb-4011-a6d6-f16dff180486 owned by network:router_interface {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:10:35.069502 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:35.072372 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a2a2a19a-1bd1-488d-b8ba-e05626aff3bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:35.095025 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] Pushing event deleted for resources: {'Port': ['ID=a33b3689-e1bb-4011-a6d6-f16dff180486,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:35.098096 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:35.277534 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7899567', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8355178'] for router_interface, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:35.479468 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] Router a17f3ab0-fe2c-4834-806d-28b3794b6366 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:10:35.598483 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:10:35.603349 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-1ff09d4b-557e-4339-8baf-77227488caf3 admin admin] 10.222.0.41 "PUT /v2.0/routers/a17f3ab0-fe2c-4834-806d-28b3794b6366/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9903219 Jun 17 11:10:35.605828 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41284) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:35.608567 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95af56c7-fbf3-466f-a42e-898da69b75d4 None None] Sync routers for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:10:35.619065 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95af56c7-fbf3-466f-a42e-898da69b75d4 None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:35.619787 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-95af56c7-fbf3-466f-a42e-898da69b75d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:10:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:35.710121 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Notify callbacks [] for router, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:35.723560 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-95af56c7-fbf3-466f-a42e-898da69b75d4 None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:35.845071 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:35.882181 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ad62e8f-f44c-43da-90c8-313e31a74b86 req-ab3bdd50-5e6a-41d2-993f-3c3b131e8f5d tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:35.883789 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8ad62e8f-f44c-43da-90c8-313e31a74b86 req-ab3bdd50-5e6a-41d2-993f-3c3b131e8f5d tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 944 time: 0.0844762 Jun 17 11:10:35.916258 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-95af56c7-fbf3-466f-a42e-898da69b75d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241'}], 'enable_snat': True}, 'gw_port_id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T11:10:34Z', 'revision_number': 5, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port': {'id': '6e11f01c-6a5e-4843-8522-d954d8b50545', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ab:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T10:59:13Z', 'updated_at': '2021-06-17T10:59:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:35.925832 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8ad62e8f-f44c-43da-90c8-313e31a74b86 req-3857caf4-3d7e-488e-a480-3b503473936d tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0361419 Jun 17 11:10:35.945702 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95af56c7-fbf3-466f-a42e-898da69b75d4 None None] Checking router: a17f3ab0-fe2c-4834-806d-28b3794b6366 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:10:35.966324 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95af56c7-fbf3-466f-a42e-898da69b75d4 None None] Routers {'a17f3ab0-fe2c-4834-806d-28b3794b6366'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:35.967051 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-95af56c7-fbf3-466f-a42e-898da69b75d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:10:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a17f3ab0-fe2c-4834-806d-28b3794b6366'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:35.980965 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Deleting port 6e11f01c-6a5e-4843-8522-d954d8b50545 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:10:35.981191 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.013911 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b81b9782-a682-41ab-a446-b84728aaa64c req-9bafc465-d1c1-4a53-a693-8b92102b0529 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:36.016347 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b81b9782-a682-41ab-a446-b84728aaa64c req-9bafc465-d1c1-4a53-a693-8b92102b0529 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0766692 Jun 17 11:10:36.059367 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b81b9782-a682-41ab-a446-b84728aaa64c req-77d52c21-d796-4a1a-990a-6fbc4e2b3082 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0371137 Jun 17 11:10:36.062472 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-95af56c7-fbf3-466f-a42e-898da69b75d4 None None] Set router a17f3ab0-fe2c-4834-806d-28b3794b6366 gateway port host: None {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:36.085915 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] For port 6e11f01c-6a5e-4843-8522-d954d8b50545, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=6e11f01c-6a5e-4843-8522-d954d8b50545,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:36.086277 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.116816 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-95af56c7-fbf3-466f-a42e-898da69b75d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T11:10:35Z', 'revision_number': 6, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port_host': None}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:36.146496 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95af56c7-fbf3-466f-a42e-898da69b75d4 None None] The sync data for ids ['a17f3ab0-fe2c-4834-806d-28b3794b6366'] in dv-cinder-773870-6-iscsi is: [{'id': 'a17f3ab0-fe2c-4834-806d-28b3794b6366', 'name': 'tempest-AttachVolumeTestJSON-584412811-router', 'tenant_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T10:59:12Z', 'updated_at': '2021-06-17T11:10:35Z', 'revision_number': 6, 'project_id': 'f15e97a8adc74580bf4df14ed664fc3f', 'gw_port_host': None}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:10:36.161695 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Calling delete_port for 6e11f01c-6a5e-4843-8522-d954d8b50545 owned by network:router_gateway {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:10:36.318010 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-836f58cc-42b9-4bca-ac11-08b4e7284f78 req-2d21095e-7920-4d5d-acf3-e1b1bcbf1e54 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:36.319385 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-836f58cc-42b9-4bca-ac11-08b4e7284f78 req-2d21095e-7920-4d5d-acf3-e1b1bcbf1e54 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.1414442 Jun 17 11:10:36.328291 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41292) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:36.334588 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-368b7ec2-a665-46a5-a132-94a08c35c1af tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Request body: {'floatingip': {'port_id': 'bb8e800d-0d92-4757-af24-da32b3db8d82'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:36.375549 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-368b7ec2-a665-46a5-a132-94a08c35c1af tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.452493 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.455513 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:36.480453 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Pushing event deleted for resources: {'Port': ['ID=6e11f01c-6a5e-4843-8522-d954d8b50545,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:36.517278 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:36.554036 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device a33b3689-e1bb-4011-a6d6-f16dff180486 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:10:36.567053 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8286505'] for router_gateway, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.575853 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: a33b3689-e1bb-4011-a6d6-f16dff180486 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:10:36.576455 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device a33b3689-e1bb-4011-a6d6-f16dff180486 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:10:36.667268 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8357994', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2026'] for router, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.669437 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.706595 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 05c3d654-1803-4edd-9ea3-44a8afd65285 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:10:36.806740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8291427'] for router, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.807759 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a17f3ab0-fe2c-4834-806d-28b3794b6366 {{(pid=110215) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Jun 17 11:10:36.810468 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 05c3d654-1803-4edd-9ea3-44a8afd65285, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=05c3d654-1803-4edd-9ea3-44a8afd65285,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:36.814140 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] Notify callbacks [] for router, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.816007 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-de71e47a-da28-43ef-aad2-8f418e23c022 admin admin] 10.222.0.41 "DELETE /v2.0/routers/a17f3ab0-fe2c-4834-806d-28b3794b6366 HTTP/1.1" status: 204 len: 168 time: 1.2089949 Jun 17 11:10:36.818499 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41294) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:36.828173 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'port_id': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'mac_address': 'fa:16:3e:5b:e8:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 135, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:10:36.873393 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.883186 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_v2 [None req-93b7374f-afed-4f07-9450-34e2c03b5ed1 admin admin] Deleting subnet b70c69a2-cf24-49e5-90dd-a210bd42e6bb {{(pid=110215) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:10:36.889577 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93b7374f-afed-4f07-9450-34e2c03b5ed1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.891163 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 05c3d654-1803-4edd-9ea3-44a8afd65285 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:10:36.922263 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 05c3d654-1803-4edd-9ea3-44a8afd65285, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=05c3d654-1803-4edd-9ea3-44a8afd65285,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:36.924097 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-368b7ec2-a665-46a5-a132-94a08c35c1af tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.935019 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93b7374f-afed-4f07-9450-34e2c03b5ed1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6032829'] for subnet, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.996080 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:36.998879 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-b93a3b8a-1969-44c1-8a01-8d752794fa7a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:37.017869 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93b7374f-afed-4f07-9450-34e2c03b5ed1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:37.026076 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-368b7ec2-a665-46a5-a132-94a08c35c1af tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:37.063639 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=05c3d654-1803-4edd-9ea3-44a8afd65285,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:37.066832 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:37.174801 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93b7374f-afed-4f07-9450-34e2c03b5ed1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5898882', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5636066'] for subnet, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:37.175771 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.l3_db [None req-368b7ec2-a665-46a5-a132-94a08c35c1af tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Floating IP d0828cf5-defc-4c2c-8ddb-25ca72755d92 associated. External IP: 172.27.3.106, port: bb8e800d-0d92-4757-af24-da32b3db8d82. Jun 17 11:10:37.178595 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:37.211150 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93b7374f-afed-4f07-9450-34e2c03b5ed1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b70c69a2-cf24-49e5-90dd-a210bd42e6bb,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:37.214829 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-93b7374f-afed-4f07-9450-34e2c03b5ed1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:37.215833 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-93b7374f-afed-4f07-9450-34e2c03b5ed1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:37.224587 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-93b7374f-afed-4f07-9450-34e2c03b5ed1 admin admin] 10.222.0.41 "DELETE /v2.0/subnets/b70c69a2-cf24-49e5-90dd-a210bd42e6bb HTTP/1.1" status: 204 len: 168 time: 0.3977749 Jun 17 11:10:37.224696 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41298) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:37.225797 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d43a7c8e-5c12-4354-a956-76256e0990a7 None None] Network 54973ccd-0b2b-4517-ad28-76a3128a2da3 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:10:37.259660 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe76c8a2-cca7-4271-a638-a7d0d2c7c5af req-8b4279c3-7756-457b-a573-f1d773b44892 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:37.261432 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fe76c8a2-cca7-4271-a638-a7d0d2c7c5af req-8b4279c3-7756-457b-a573-f1d773b44892 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 945 time: 0.1894658 Jun 17 11:10:37.383982 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['05c3d654-1803-4edd-9ea3-44a8afd65285'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:10:37.438601 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d8a0039-f0fe-4940-a433-a0fcab566d4a None None] DHCP port deletion for 54973ccd-0b2b-4517-ad28-76a3128a2da3 request from dv-cinder-773870-6-iscsi {{(pid=110216) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Jun 17 11:10:37.547440 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-3d8a0039-f0fe-4940-a433-a0fcab566d4a None None] Deleting port 9a80deac-57f8-4a0e-a926-2352dfa6b72b {{(pid=110216) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:10:37.547823 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3d8a0039-f0fe-4940-a433-a0fcab566d4a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:37.617643 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fe76c8a2-cca7-4271-a638-a7d0d2c7c5af req-f90462b6-ccc2-48b2-ae10-8cde589ec735 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3392458 Jun 17 11:10:37.621940 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:37.642275 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-3d8a0039-f0fe-4940-a433-a0fcab566d4a None None] For port 9a80deac-57f8-4a0e-a926-2352dfa6b72b, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=9a80deac-57f8-4a0e-a926-2352dfa6b72b,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:37.642714 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3d8a0039-f0fe-4940-a433-a0fcab566d4a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:37.724931 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-3d8a0039-f0fe-4940-a433-a0fcab566d4a None None] Calling delete_port for 9a80deac-57f8-4a0e-a926-2352dfa6b72b owned by network:dhcp {{(pid=110216) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:10:37.778830 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Deleting port 9a80deac-57f8-4a0e-a926-2352dfa6b72b {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:10:37.779179 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:37.784077 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:37.784603 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-368b7ec2-a665-46a5-a132-94a08c35c1af tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Router a0be9488-bc15-4149-b213-8c5540303580 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:10:37.904024 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3d8a0039-f0fe-4940-a433-a0fcab566d4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159'] for port, after_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:37.906256 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:37.920573 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] For port 9a80deac-57f8-4a0e-a926-2352dfa6b72b, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=9a80deac-57f8-4a0e-a926-2352dfa6b72b,segment=NetworkSegment(0b3760d5-4271-497d-a20f-fec4d6ed355c),segment_id=0b3760d5-4271-497d-a20f-fec4d6ed355c)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:37.921344 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:37.929929 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d8a0039-f0fe-4940-a433-a0fcab566d4a None None] Pushing event deleted for resources: {'Port': ['ID=9a80deac-57f8-4a0e-a926-2352dfa6b72b,revision_number=None']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:37.934352 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-3d8a0039-f0fe-4940-a433-a0fcab566d4a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:37.937157 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d8a0039-f0fe-4940-a433-a0fcab566d4a None None] No DVR routers for this DVR port 9a80deac-57f8-4a0e-a926-2352dfa6b72b on host dv-cinder-773870-6-iscsi {{(pid=110216) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:10:37.996236 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Calling delete_port for 9a80deac-57f8-4a0e-a926-2352dfa6b72b owned by network:dhcp {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:10:38.057617 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-368b7ec2-a665-46a5-a132-94a08c35c1af tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:10:38.062996 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-368b7ec2-a665-46a5-a132-94a08c35c1af tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:38.067389 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a9bf930-3fd3-4ef5-81a9-14fdaeb78fbf None None] Sync routers for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:10:38.078330 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a9bf930-3fd3-4ef5-81a9-14fdaeb78fbf None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:38.079243 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1a9bf930-3fd3-4ef5-81a9-14fdaeb78fbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:10:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:38.120710 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-368b7ec2-a665-46a5-a132-94a08c35c1af tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "PUT /v2.0/floatingips/d0828cf5-defc-4c2c-8ddb-25ca72755d92 HTTP/1.1" status: 200 len: 991 time: 1.7874920 Jun 17 11:10:38.120710 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82'}] {{(pid=110214) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:10:38.121560 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cc2cf72888dbbd14a3b8c118b05d43e907687f619eecab2abc2da29781eba8b9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-222c35b1-d1a3-45c9-919d-2e40329a8a87" -d '{"events": [{"name": "network-changed", "server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82"}]}' {{(pid=110214) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:10:38.125732 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:38.127687 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:38.153565 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Pushing event deleted for resources: {'Port': ['ID=9a80deac-57f8-4a0e-a926-2352dfa6b72b,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:38.155953 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:38.158173 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] No DVR routers for this DVR port 9a80deac-57f8-4a0e-a926-2352dfa6b72b on host dv-cinder-773870-6-iscsi {{(pid=110214) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:10:38.184357 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:10:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd213d4a-3023-475f-879b-6fd163e3243a x-openstack-request-id: req-dd213d4a-3023-475f-879b-6fd163e3243a {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:10:38.184677 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82", "status": "completed", "code": 200}]} {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:10:38.184969 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-dd213d4a-3023-475f-879b-6fd163e3243a {{(pid=110214) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:10:38.185388 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'status': 'completed', 'code': 200} Jun 17 11:10:38.187631 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-1a9bf930-3fd3-4ef5-81a9-14fdaeb78fbf None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:38.238045 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:38.250003 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['54973ccd-0b2b-4517-ad28-76a3128a2da3']}} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:38.263094 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0b3760d5-4271-497d-a20f-fec4d6ed355c') {'for_net_delete': True} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:38.263380 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0b3760d5-4271-497d-a20f-fec4d6ed355c') {} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:38.274248 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6228436'] for segment, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:38.293206 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:38.301439 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Releasing vlan 126 on physical network physnet1 to pool {{(pid=110214) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:10:38.302568 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6239464'] for segment, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: retrieve_revision_numbers = { Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:680: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: self.session.flush() Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:680: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: self.session.flush() Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:680: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: self.session.flush() Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:680: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: self.session.flush() Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: Traceback (most recent call last): Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: timer() Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: cb(*args, **kw) Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: return func(*args, **kwargs) Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: self._notify() Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: self.callback(batched_events) Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: event.method(event) Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: return f(self, *a, **k) Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._get(url).json() Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: return self.request(url, 'GET', **kwargs) Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:10:38.304271 dv-cinder-773870-6-iscsi neutron-server[110214]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:10:38.314124 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 9a80deac-57f8-4a0e-a926-2352dfa6b72b no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:10:38.325490 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-222c35b1-d1a3-45c9-919d-2e40329a8a87 req-9724fd07-e7fd-4088-af7d-b337a7d0529e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:38.327664 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-222c35b1-d1a3-45c9-919d-2e40329a8a87 req-9724fd07-e7fd-4088-af7d-b337a7d0529e service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 1098 time: 0.1160202 Jun 17 11:10:38.334400 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 9a80deac-57f8-4a0e-a926-2352dfa6b72b {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:10:38.334695 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 9a80deac-57f8-4a0e-a926-2352dfa6b72b not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:10:38.335160 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 6e11f01c-6a5e-4843-8522-d954d8b50545 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:10:38.355341 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 6e11f01c-6a5e-4843-8522-d954d8b50545 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:10:38.355724 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 6e11f01c-6a5e-4843-8522-d954d8b50545 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:10:38.433366 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-222c35b1-d1a3-45c9-919d-2e40329a8a87 req-1c0acb59-a8da-4c9d-b0fc-9af806a35e0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:38.434588 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-222c35b1-d1a3-45c9-919d-2e40329a8a87 req-1c0acb59-a8da-4c9d-b0fc-9af806a35e0e service neutron] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 918 time: 0.0991247 Jun 17 11:10:38.447640 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1a9bf930-3fd3-4ef5-81a9-14fdaeb78fbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'd0828cf5-defc-4c2c-8ddb-25ca72755d92', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'floating_ip_address': '172.27.3.106', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'port_id': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 599, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'mac_address': 'fa:16:3e:b3:98:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:15Z', 'updated_at': '2021-06-17T11:10:36Z', 'revision_number': 1, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:38.465967 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:38.469887 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b115bab1-5b2d-4f8a-ad91-21cca28c676f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:38.472582 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:38.481071 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] 10.222.0.41 "DELETE /v2.0/networks/54973ccd-0b2b-4517-ad28-76a3128a2da3 HTTP/1.1" status: 204 len: 168 time: 1.2531755 Jun 17 11:10:38.481193 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a9bf930-3fd3-4ef5-81a9-14fdaeb78fbf None None] Checking router: a0be9488-bc15-4149-b213-8c5540303580 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:10:38.487107 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a9bf930-3fd3-4ef5-81a9-14fdaeb78fbf None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:38.487802 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1a9bf930-3fd3-4ef5-81a9-14fdaeb78fbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:10:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:38.488040 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Pushing event deleted for resources: {'Network': ['ID=54973ccd-0b2b-4517-ad28-76a3128a2da3,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:38.494136 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-8187453b-03d5-4a42-a807-b6d304276acb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:38.517627 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-222c35b1-d1a3-45c9-919d-2e40329a8a87 req-713a4d09-a31f-4330-9f5d-fcc723623959 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=bb8e800d-0d92-4757-af24-da32b3db8d82 HTTP/1.1" status: 200 len: 999 time: 0.0743065 Jun 17 11:10:38.575958 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-222c35b1-d1a3-45c9-919d-2e40329a8a87 req-5be35404-2229-45a6-95df-44eee4cf1c3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:38.577542 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-222c35b1-d1a3-45c9-919d-2e40329a8a87 req-5be35404-2229-45a6-95df-44eee4cf1c3e service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0505695 Jun 17 11:10:38.598612 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-1a9bf930-3fd3-4ef5-81a9-14fdaeb78fbf None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:38.635288 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-222c35b1-d1a3-45c9-919d-2e40329a8a87 req-889316b7-2856-4af7-99b1-ab5764d9bb9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:38.637013 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-222c35b1-d1a3-45c9-919d-2e40329a8a87 req-889316b7-2856-4af7-99b1-ab5764d9bb9f service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0518954 Jun 17 11:10:38.742941 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 05c3d654-1803-4edd-9ea3-44a8afd65285 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:10:38.758341 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-222c35b1-d1a3-45c9-919d-2e40329a8a87 req-be354122-c9cf-4e41-8503-f90c1878b12e service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1142497 Jun 17 11:10:38.842054 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416fd515-2283-4f5f-bc30-65441e741fbd req-1d80029b-b2de-4001-b716-13d733755170 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:38.843800 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-416fd515-2283-4f5f-bc30-65441e741fbd req-1d80029b-b2de-4001-b716-13d733755170 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 945 time: 0.0956538 Jun 17 11:10:38.844418 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41308) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:38.849727 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-1a9bf930-3fd3-4ef5-81a9-14fdaeb78fbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'd0828cf5-defc-4c2c-8ddb-25ca72755d92', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'floating_ip_address': '172.27.3.106', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'port_id': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 599, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'mac_address': 'fa:16:3e:b3:98:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:15Z', 'updated_at': '2021-06-17T11:10:36Z', 'revision_number': 1, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:38.876135 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a9bf930-3fd3-4ef5-81a9-14fdaeb78fbf None None] The sync data for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi is: [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'd0828cf5-defc-4c2c-8ddb-25ca72755d92', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'floating_ip_address': '172.27.3.106', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'port_id': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 599, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'mac_address': 'fa:16:3e:b3:98:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:15Z', 'updated_at': '2021-06-17T11:10:36Z', 'revision_number': 1, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:10:38.882248 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-222c35b1-d1a3-45c9-919d-2e40329a8a87 req-78dfb5c8-f312-4e38-880f-9a527498cdfc service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1168110 Jun 17 11:10:38.900260 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 05c3d654-1803-4edd-9ea3-44a8afd65285 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:10:38.904479 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 05c3d654-1803-4edd-9ea3-44a8afd65285 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:10:38.904872 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:38.912575 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-416fd515-2283-4f5f-bc30-65441e741fbd req-6ab2e728-6792-4cc7-a169-857bdac78698 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0612342 Jun 17 11:10:38.918760 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-126f7253-916d-48e6-83aa-9777c1b4b322 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=f15e97a8adc74580bf4df14ed664fc3f&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0708241 Jun 17 11:10:38.918902 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41310) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:38.977408 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-39d84de5-b099-4dbd-aca7-535380601b7e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:38.986317 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:38.999150 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-39d84de5-b099-4dbd-aca7-535380601b7e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:39.012844 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '05c3d654-1803-4edd-9ea3-44a8afd65285'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:10:39.019039 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0eeec104-4596-44b5-babd-c1992cb109dd" -d '{"events": [{"server_uuid": "ea22557b-cbc7-47a3-9ae1-915b71aefe0b", "name": "network-vif-plugged", "status": "completed", "tag": "05c3d654-1803-4edd-9ea3-44a8afd65285"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:10:39.029240 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 05c3d654-1803-4edd-9ea3-44a8afd65285, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=05c3d654-1803-4edd-9ea3-44a8afd65285,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:10:39.057654 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:10:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fb59933d-55f0-46d4-9103-dc32e12303de x-openstack-request-id: req-fb59933d-55f0-46d4-9103-dc32e12303de {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:10:39.057957 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ea22557b-cbc7-47a3-9ae1-915b71aefe0b", "name": "network-vif-plugged", "status": "completed", "tag": "05c3d654-1803-4edd-9ea3-44a8afd65285", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:10:39.058217 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-fb59933d-55f0-46d4-9103-dc32e12303de {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:10:39.058645 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'code': 200} Jun 17 11:10:39.094666 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:39.096819 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:39.123818 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-39d84de5-b099-4dbd-aca7-535380601b7e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:39.127728 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-39d84de5-b099-4dbd-aca7-535380601b7e admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:39.140785 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-39d84de5-b099-4dbd-aca7-535380601b7e admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/84a85e25-ad7a-4f18-b88e-f313010f982b HTTP/1.1" status: 204 len: 168 time: 0.2123392 Jun 17 11:10:39.140785 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-085c730b-2f4e-47ff-b46c-698997f4ed6f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:39.142449 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39d84de5-b099-4dbd-aca7-535380601b7e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84a85e25-ad7a-4f18-b88e-f313010f982b,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:39.143212 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a5fdb6a-0fdd-426b-8376-02a63a9339d9 None None] New status for floating IP d0828cf5-defc-4c2c-8ddb-25ca72755d92: ACTIVE {{(pid=110216) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:10:39.144929 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-39d84de5-b099-4dbd-aca7-535380601b7e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:39.199147 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=05c3d654-1803-4edd-9ea3-44a8afd65285,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:39.202477 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:39.497255 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61279eed-6973-41b8-85f7-7882c1d31246 req-3f6316ac-1577-4c65-8c10-90307dd47bbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:39.498757 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-61279eed-6973-41b8-85f7-7882c1d31246 req-3f6316ac-1577-4c65-8c10-90307dd47bbb service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 1099 time: 0.0614319 Jun 17 11:10:39.542645 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-61279eed-6973-41b8-85f7-7882c1d31246 req-e4089387-1d16-49e4-b056-340c618507d6 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318158 Jun 17 11:10:40.092387 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-256b8a29-e845-435c-83cf-0319c0eae565 req-c246b62f-20b6-485f-b899-176d6cc0b3f6 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:40.094010 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-256b8a29-e845-435c-83cf-0319c0eae565 req-c246b62f-20b6-485f-b899-176d6cc0b3f6 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 946 time: 0.0656517 Jun 17 11:10:40.131236 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-256b8a29-e845-435c-83cf-0319c0eae565 req-ed7889be-e986-4c16-9859-71bfc8c972a2 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310576 Jun 17 11:10:41.327798 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0621acf0-7f01-4e6f-add5-4bd420bb9ed1 req-159bc8d8-85b4-4ae4-b91f-ca08a67d1296 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:41.329284 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0621acf0-7f01-4e6f-add5-4bd420bb9ed1 req-159bc8d8-85b4-4ae4-b91f-ca08a67d1296 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 946 time: 0.0701983 Jun 17 11:10:41.370117 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0621acf0-7f01-4e6f-add5-4bd420bb9ed1 req-7d423f35-f574-404e-bd39-710212fc7581 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0347164 Jun 17 11:10:41.543254 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332cf81b-2325-4941-b2fa-e7504b2da48b req-55c0b0e3-98d3-4ce0-bca9-07633ffe6a3c tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:41.544849 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-332cf81b-2325-4941-b2fa-e7504b2da48b req-55c0b0e3-98d3-4ce0-bca9-07633ffe6a3c tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 946 time: 0.0644834 Jun 17 11:10:41.583374 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-332cf81b-2325-4941-b2fa-e7504b2da48b req-35cb0265-0e85-4dcd-8ec2-49f6805b09dc tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319738 Jun 17 11:10:41.607965 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41370) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:41.676829 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c876ad9b-a4b2-46ec-9088-32f6cea464d8 tempest-TestVolumeBootPattern-1850253723 tempest-TestVolumeBootPattern-1850253723-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:41.678361 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-c876ad9b-a4b2-46ec-9088-32f6cea464d8 tempest-TestVolumeBootPattern-1850253723 tempest-TestVolumeBootPattern-1850253723-project-admin] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 1094 time: 0.0694010 Jun 17 11:10:41.683092 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41374) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:41.688188 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.v2.base [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'floatingip': {'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'port_id': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address': '172.20.0.11'}} {{(pid=110214) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:41.766215 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41378) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:41.797428 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:41.877901 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d6222b06-af69-44f5-ab35-79ce87830d07 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:41.903144 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:41.971855 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d6222b06-af69-44f5-ab35-79ce87830d07 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:42.011940 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_common [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Allocated IP 172.27.3.216 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/07f72c25-2af1-4a82-b942-13ecd003a41d) {{(pid=110214) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:10:42.031506 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-d6222b06-af69-44f5-ab35-79ce87830d07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:42.035735 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-906dc87b-5317-4817-a6af-b9164903c150 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:42.071296 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-d6222b06-af69-44f5-ab35-79ce87830d07 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=f7a7ebcd80af4336a3cbfc625348d075&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3038487 Jun 17 11:10:42.072202 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6222b06-af69-44f5-ab35-79ce87830d07 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1478a8ce-a258-460e-bf52-4bbf84455431,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:42.074615 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41382) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:42.081478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d6222b06-af69-44f5-ab35-79ce87830d07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:42.122058 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for port, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:42.123771 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6420b6b5-5051-4677-8318-c23ab355d678 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:42.147540 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6420b6b5-5051-4677-8318-c23ab355d678 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:42.224910 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-6239414'] for port, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:42.229583 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-579aa751-beae-4284-9aaa-b23f7ff9b9a6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:42.263302 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110214) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:10:42.267563 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.base_scheduler [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Resources bound (agent type, host, resource id): {{(pid=110214) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:10:42.274888 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Received port after_create {{(pid=110214) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:10:42.277518 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6420b6b5-5051-4677-8318-c23ab355d678 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:42.280276 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-6420b6b5-5051-4677-8318-c23ab355d678 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:42.281486 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-6420b6b5-5051-4677-8318-c23ab355d678 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/1478a8ce-a258-460e-bf52-4bbf84455431 HTTP/1.1" status: 204 len: 168 time: 0.2059338 Jun 17 11:10:42.282077 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'Port': ['ID=07f72c25-2af1-4a82-b942-13ecd003a41d,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:42.282292 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-645351e8-8f9a-4e74-9648-e4110474b92b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:42.291749 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6420b6b5-5051-4677-8318-c23ab355d678 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1478a8ce-a258-460e-bf52-4bbf84455431,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:42.294317 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6420b6b5-5051-4677-8318-c23ab355d678 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:42.304199 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:42.633581 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:42.792337 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:42.950877 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for port, precommit_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:43.003858 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41390) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:43.018037 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b9a944d1-5faf-455c-827a-4f2a6b394a61 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:43.037725 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6239364'] for port, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:43.040783 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2263ab53-0576-4ee4-b90a-c4de05dd7152 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:43.112227 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'Port': ['ID=07f72c25-2af1-4a82-b942-13ecd003a41d,revision_number=2']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:43.112457 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b9a944d1-5faf-455c-827a-4f2a6b394a61 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:43.118569 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:43.126668 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:43.191826 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b9a944d1-5faf-455c-827a-4f2a6b394a61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:43.194995 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4a6e6546-6e96-41ba-89f5-645823e3e5e9 tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:43.229294 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.l3_db [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Floating IP e73e0dd6-cc1b-4554-94ac-70a98e85d0fe associated. External IP: 172.27.3.216, port: 05c3d654-1803-4edd-9ea3-44a8afd65285. Jun 17 11:10:43.229784 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a944d1-5faf-455c-827a-4f2a6b394a61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08df39b8-aa6d-4fd6-b684-bb0461516a7c,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:43.236511 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-b9a944d1-5faf-455c-827a-4f2a6b394a61 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=1b9ba0620a27489c9cca5ec8bc69a684&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2287254 Jun 17 11:10:43.236511 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-b9a944d1-5faf-455c-827a-4f2a6b394a61 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:43.238303 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41392) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:43.288481 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ce3d97fa-745a-4103-b381-89a5a8418519 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:43.310814 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ce3d97fa-745a-4103-b381-89a5a8418519 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:43.446247 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:10:43.466047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ce3d97fa-745a-4103-b381-89a5a8418519 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:43.468517 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ce3d97fa-745a-4103-b381-89a5a8418519 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:43.471996 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-ce3d97fa-745a-4103-b381-89a5a8418519 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/08df39b8-aa6d-4fd6-b684-bb0461516a7c HTTP/1.1" status: 204 len: 168 time: 0.2320466 Jun 17 11:10:43.471996 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-56d4f19e-9a37-4cde-bd0a-7cfa71456495 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:43.479690 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce3d97fa-745a-4103-b381-89a5a8418519 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08df39b8-aa6d-4fd6-b684-bb0461516a7c,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:43.482001 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ce3d97fa-745a-4103-b381-89a5a8418519 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:43.560801 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:10:43.571234 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81826f3e-603e-4c4f-a0d6-722bbc2f945c None None] Sync routers for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:10:43.583674 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81826f3e-603e-4c4f-a0d6-722bbc2f945c None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:43.584305 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-81826f3e-603e-4c4f-a0d6-722bbc2f945c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:10:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:43.679110 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:43.702151 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-81826f3e-603e-4c4f-a0d6-722bbc2f945c None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:43.738565 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-2619341c-3d4b-485c-a908-682edc2b13ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.0538876 Jun 17 11:10:43.739917 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'tag': '05c3d654-1803-4edd-9ea3-44a8afd65285'}] {{(pid=110214) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:10:43.742305 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cc2cf72888dbbd14a3b8c118b05d43e907687f619eecab2abc2da29781eba8b9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-31ac3b86-a665-4119-ae09-cf9c78b84c3a" -d '{"events": [{"name": "network-changed", "server_uuid": "ea22557b-cbc7-47a3-9ae1-915b71aefe0b", "tag": "05c3d654-1803-4edd-9ea3-44a8afd65285"}]}' {{(pid=110214) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:10:43.779264 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:10:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-10abd6d2-9c91-4632-ac9d-92ff0a4074bc x-openstack-request-id: req-10abd6d2-9c91-4632-ac9d-92ff0a4074bc {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:10:43.779651 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ea22557b-cbc7-47a3-9ae1-915b71aefe0b", "tag": "05c3d654-1803-4edd-9ea3-44a8afd65285", "status": "completed", "code": 200}]} {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:10:43.794299 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-10abd6d2-9c91-4632-ac9d-92ff0a4074bc {{(pid=110214) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:10:43.794299 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'tag': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'status': 'completed', 'code': 200} Jun 17 11:10:43.865515 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ac3b86-a665-4119-ae09-cf9c78b84c3a req-47a7b8f2-3e1a-4390-a882-118c63a42a35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:43.867052 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-31ac3b86-a665-4119-ae09-cf9c78b84c3a req-47a7b8f2-3e1a-4390-a882-118c63a42a35 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 1099 time: 0.0612640 Jun 17 11:10:43.974839 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ac3b86-a665-4119-ae09-cf9c78b84c3a req-207a3bf5-4663-4ea6-815d-934b7f3d4823 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:43.976331 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-31ac3b86-a665-4119-ae09-cf9c78b84c3a req-207a3bf5-4663-4ea6-815d-934b7f3d4823 service neutron] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 913 time: 0.1005521 Jun 17 11:10:44.020019 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-81826f3e-603e-4c4f-a0d6-722bbc2f945c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'e73e0dd6-cc1b-4554-94ac-70a98e85d0fe', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.216', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:5b:e8:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:42Z', 'updated_at': '2021-06-17T11:10:42Z', 'revision_number': 0, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:44.050999 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81826f3e-603e-4c4f-a0d6-722bbc2f945c None None] Checking router: 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:10:44.059666 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81826f3e-603e-4c4f-a0d6-722bbc2f945c None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:10:44.060304 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-81826f3e-603e-4c4f-a0d6-722bbc2f945c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:10:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:44.061366 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-31ac3b86-a665-4119-ae09-cf9c78b84c3a req-5a2f0514-e16b-42ff-a6b0-fe3138deff0b service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=05c3d654-1803-4edd-9ea3-44a8afd65285 HTTP/1.1" status: 200 len: 1000 time: 0.0696478 Jun 17 11:10:44.124688 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ac3b86-a665-4119-ae09-cf9c78b84c3a req-f792654c-4e7b-4151-8c17-e24ec1f0632c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:44.126296 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-31ac3b86-a665-4119-ae09-cf9c78b84c3a req-f792654c-4e7b-4151-8c17-e24ec1f0632c service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0561559 Jun 17 11:10:44.170392 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-81826f3e-603e-4c4f-a0d6-722bbc2f945c None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:10:44.186469 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ac3b86-a665-4119-ae09-cf9c78b84c3a req-4f7b0549-684a-43ca-af6c-35b634614c26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:44.188131 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-31ac3b86-a665-4119-ae09-cf9c78b84c3a req-4f7b0549-684a-43ca-af6c-35b634614c26 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0539105 Jun 17 11:10:44.294048 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-31ac3b86-a665-4119-ae09-cf9c78b84c3a req-be9e7fe2-269e-4bd3-99dd-1b12e74c3892 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0961344 Jun 17 11:10:44.390536 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-31ac3b86-a665-4119-ae09-cf9c78b84c3a req-0f82750f-c249-411a-8e62-0cdcce45e8f5 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867317 Jun 17 11:10:44.404482 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-81826f3e-603e-4c4f-a0d6-722bbc2f945c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'e73e0dd6-cc1b-4554-94ac-70a98e85d0fe', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.216', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:5b:e8:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:42Z', 'updated_at': '2021-06-17T11:10:42Z', 'revision_number': 0, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:10:44.434819 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81826f3e-603e-4c4f-a0d6-722bbc2f945c None None] The sync data for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi is: [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'e73e0dd6-cc1b-4554-94ac-70a98e85d0fe', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.216', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:5b:e8:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:42Z', 'updated_at': '2021-06-17T11:10:42Z', 'revision_number': 0, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:10:44.620214 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-708212b9-c2d2-4a66-af95-d3d0f3e8edca None None] New status for floating IP e73e0dd6-cc1b-4554-94ac-70a98e85d0fe: ACTIVE {{(pid=110216) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:10:50.697945 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-ebddd05f-7dd5-47e8-a7e9-ed02d5ac7f62 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:50.878631 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41486) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:50.983498 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9ba30878-3518-47e7-bac3-d6059330ff51 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:51.084796 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9ba30878-3518-47e7-bac3-d6059330ff51 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:51.185537 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9ba30878-3518-47e7-bac3-d6059330ff51 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:51.187988 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6420b6b5-5051-4677-8318-c23ab355d678 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:51.228270 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-9ba30878-3518-47e7-bac3-d6059330ff51 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=385d9df308924c299b7113dc5afbdbde&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3478980 Jun 17 11:10:51.228965 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ba30878-3518-47e7-bac3-d6059330ff51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64e54107-e550-4d64-bed6-49fac4761d11,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:51.230987 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41490) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:51.232076 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9ba30878-3518-47e7-bac3-d6059330ff51 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:51.280953 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-25edf7bd-0e3a-4aee-8737-a28a575f37ed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:51.300824 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-25edf7bd-0e3a-4aee-8737-a28a575f37ed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:51.448513 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-25edf7bd-0e3a-4aee-8737-a28a575f37ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:51.451218 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-25edf7bd-0e3a-4aee-8737-a28a575f37ed admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:51.452477 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-25edf7bd-0e3a-4aee-8737-a28a575f37ed admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/64e54107-e550-4d64-bed6-49fac4761d11 HTTP/1.1" status: 204 len: 168 time: 0.2203579 Jun 17 11:10:51.453389 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-8afb3be8-898b-4d25-817c-33f954222a44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:51.461004 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25edf7bd-0e3a-4aee-8737-a28a575f37ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64e54107-e550-4d64-bed6-49fac4761d11,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:51.463397 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-25edf7bd-0e3a-4aee-8737-a28a575f37ed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:52.092694 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 41498) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:52.106545 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b69df099-b929-424d-8d73-1f15df565d76 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:52.192075 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b69df099-b929-424d-8d73-1f15df565d76 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:52.274862 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-b69df099-b929-424d-8d73-1f15df565d76 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:52.278230 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-1cf967eb-498f-4f90-8616-1db936e2533b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:52.313860 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-b69df099-b929-424d-8d73-1f15df565d76 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=e53d6519e7574757a2846f8d64ac0b2a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2200301 Jun 17 11:10:52.314796 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b69df099-b929-424d-8d73-1f15df565d76 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=02ce8ce6-7680-4d4d-a59a-fc65c14724cd,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:52.316515 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41500) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:52.317805 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b69df099-b929-424d-8d73-1f15df565d76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:52.365312 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1e3a7d6d-ce28-40de-9a29-d62be66cd6cc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:52.389467 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1e3a7d6d-ce28-40de-9a29-d62be66cd6cc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:52.514625 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1e3a7d6d-ce28-40de-9a29-d62be66cd6cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:52.517299 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-1e3a7d6d-ce28-40de-9a29-d62be66cd6cc admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:52.518417 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-1e3a7d6d-ce28-40de-9a29-d62be66cd6cc admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/02ce8ce6-7680-4d4d-a59a-fc65c14724cd HTTP/1.1" status: 204 len: 168 time: 0.2008357 Jun 17 11:10:52.519202 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-06360ce0-50a4-44a9-9df5-14b2b8802529 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:52.527121 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e3a7d6d-ce28-40de-9a29-d62be66cd6cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=02ce8ce6-7680-4d4d-a59a-fc65c14724cd,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:52.529300 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-1e3a7d6d-ce28-40de-9a29-d62be66cd6cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:53.043906 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:10:53.363046 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-c78c9a80-0914-4f07-a480-c7be87f93b05 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:53.524423 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41524) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:53.569264 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:53.618080 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-201433475-network', 'tenant_id': '2cebe420e11c4e19890964552961967d'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:53.711331 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Made reservation on behalf of 2cebe420e11c4e19890964552961967d for: {'network': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:10:53.713820 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for network, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:53.722589 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:53.811212 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:53.882937 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:53.886475 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-a2c7e6df-5e0e-4911-a0f4-f4ac989585ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:53.908344 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] vlan segment allocate from pool success with {'vlan_id': 110, 'physical_network': 'physnet1'} {{(pid=110215) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Jun 17 11:10:53.916911 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=803c65cf-9f25-48a9-8169-d7775d8209a7,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:53.920443 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:53.923200 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:53.923543 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.segments_db [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Added segment 1084bb90-956a-41ba-b787-bacf37c2838b of type vlan for network 6fdf215c-4b9a-4c97-8019-724657b01fd2 Jun 17 11:10:53.964897 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8743357762708'] for network, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:54.077048 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476'] for network, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:54.078492 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:54.079093 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:54.081149 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:54.135625 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Pushing event updated for resources: {'Network': ['ID=6fdf215c-4b9a-4c97-8019-724657b01fd2,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:54.138617 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:54.146426 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Network 6fdf215c-4b9a-4c97-8019-724657b01fd2 details requested by agent ovs-agent-dv-cinder-773870-6-iscsi with host dv-cinder-773870-6-iscsi {{(pid=110216) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Jun 17 11:10:54.178296 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] 10.222.0.41 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.6527123 Jun 17 11:10:54.181198 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 41528) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:10:54.185990 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Request body: {'subnet': {'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-201433475-subnet', 'tenant_id': '2cebe420e11c4e19890964552961967d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:10:54.288329 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Made reservation on behalf of 2cebe420e11c4e19890964552961967d for: {'subnet': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:10:54.290750 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5636039'] for subnet, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:54.476907 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:54.540180 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5898957', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5636053'] for subnet, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:54.542627 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:10:54.594277 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Pushing event updated for resources: {'Subnet': ['ID=5bd26c6d-2b2f-4a7b-b155-776ce9574191,revision_number=0']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:10:54.597969 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:10:54.605356 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Checking segment: {'id': '1084bb90-956a-41ba-b787-bacf37c2838b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:10:54.605562 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Network hostable DHCP agents. Network: 6fdf215c-4b9a-4c97-8019-724657b01fd2, hostable agents: ['3339b944-b03c-44b5-b491-f6a11c72d631'], hosted agents: [] {{(pid=110215) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Jun 17 11:10:54.694465 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Network 6fdf215c-4b9a-4c97-8019-724657b01fd2 is scheduled to be hosted by DHCP agent 3339b944-b03c-44b5-b491-f6a11c72d631 with binding_index 1 {{(pid=110215) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Jun 17 11:10:54.786453 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773870-6-iscsi, 6fdf215c-4b9a-4c97-8019-724657b01fd2) {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:10:54.790433 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:54.791047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:54.795273 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f8f997e-7cd5-4de7-b267-fb94b86d8206 None None] Network 6fdf215c-4b9a-4c97-8019-724657b01fd2 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:10:54.878248 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-9053df82-1d8d-4905-a84e-61d4535cb1bc admin admin] 10.222.0.41 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6959763 Jun 17 11:10:55.061717 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97d6374a-91ac-4629-a6fe-6f991a1f0c10 None None] Network 6fdf215c-4b9a-4c97-8019-724657b01fd2 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:10:56.840475 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:10:58.106650 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-b79b967b-bf19-4ce2-a762-6249d82d4ab3 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:10:58.108115 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-b79b967b-bf19-4ce2-a762-6249d82d4ab3 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/networks?id=6fdf215c-4b9a-4c97-8019-724657b01fd2 HTTP/1.1" status: 200 len: 808 time: 0.1027424 Jun 17 11:10:58.122362 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-323b6207-9ad0-4937-be53-daecdcc7111d tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/quotas/2cebe420e11c4e19890964552961967d HTTP/1.1" status: 200 len: 375 time: 0.0088730 Jun 17 11:10:58.155082 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-61c02be4-cc26-46fc-8ce6-5994354675e8 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=2cebe420e11c4e19890964552961967d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0276351 Jun 17 11:10:58.244614 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-5153c904-af2e-4654-a181-34d374471230 service neutron] 10.222.0.41 "GET /v2.0/networks/6fdf215c-4b9a-4c97-8019-724657b01fd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830903 Jun 17 11:10:58.330228 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-a0bfb11f-5d65-4af2-bb1b-e11721d78cf7 service neutron] 10.222.0.41 "GET /v2.0/networks/6fdf215c-4b9a-4c97-8019-724657b01fd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798335 Jun 17 11:10:58.597816 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-67b38e67-2b2f-44ad-b070-86fa5a83eeb0 req-83716ab1-9cbb-42c0-9c79-08327835e6df tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 210 time: 0.0345104 Jun 17 11:10:59.736678 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ecbde29e-7ee4-4b51-92cc-94f362d325a2 req-94f2203c-3ac9-4855-8397-037308bd8744 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 210 time: 0.0284307 Jun 17 11:11:00.875198 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-35bc57e7-7fbb-4597-bf59-f5c8778b0600 req-09b28a84-1e74-40f1-b364-2444ac6f62fa tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 210 time: 0.0292599 Jun 17 11:11:01.057200 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-e25bac48-8c79-4a15-a96c-5fe476e01cd5 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:01.058631 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-e25bac48-8c79-4a15-a96c-5fe476e01cd5 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.25 "GET /v2.0/networks?id=6fdf215c-4b9a-4c97-8019-724657b01fd2 HTTP/1.1" status: 200 len: 808 time: 0.1027365 Jun 17 11:11:01.081600 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Request body: {'port': {'device_id': '43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d', 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2', 'admin_state_up': True, 'tenant_id': '2cebe420e11c4e19890964552961967d'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:11:01.528416 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Made reservation on behalf of 2cebe420e11c4e19890964552961967d for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:11:01.532026 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:01.650955 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Allocated IP 172.20.0.14 (6fdf215c-4b9a-4c97-8019-724657b01fd2/5bd26c6d-2b2f-4a7b-b155-776ce9574191/0aa8ac82-7edc-488b-bd41-d51f5882ec5f) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:11:01.796652 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:01.894703 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:01.899610 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-caecf18a-26a0-4ffd-af87-f0befce24a8c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:01.940331 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Network 6fdf215c-4b9a-4c97-8019-724657b01fd2 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:11:01.943496 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:11:01.946720 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:11:01.982344 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Pushing event updated for resources: {'Port': ['ID=0aa8ac82-7edc-488b-bd41-d51f5882ec5f,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:01.988236 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:02.008744 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:02.009346 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:02.047448 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52ee8a5-d74d-4225-a92d-d30af0304108 req-132df18f-2f47-4285-ab96-4fc4d084a244 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:02.048825 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b52ee8a5-d74d-4225-a92d-d30af0304108 req-132df18f-2f47-4285-ab96-4fc4d084a244 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 932 time: 0.0639274 Jun 17 11:11:02.091157 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b52ee8a5-d74d-4225-a92d-d30af0304108 req-9a8489f5-b960-4714-9473-8ff9559c4135 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360990 Jun 17 11:11:02.106560 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3fbee80c-97d0-49ae-bb50-2bf9c84bbffc tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0292914 Jun 17 11:11:02.120127 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Request body: {'port': {'device_id': '43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:11:02.196951 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:02.461399 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0aa8ac82-7edc-488b-bd41-d51f5882ec5f {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:11:02.468562 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:02.479800 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Transition to ACTIVE for port object 0aa8ac82-7edc-488b-bd41-d51f5882ec5f will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:11:02.548292 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:02.551087 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f026e12f-5f4f-4250-9378-b1b1bf0ed7d8 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:02.618970 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Pushing event updated for resources: {'Port': ['ID=0aa8ac82-7edc-488b-bd41-d51f5882ec5f,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:02.623029 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:02.691312 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Attempting to bind port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:11:02.691641 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Attempting to bind port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': '1084bb90-956a-41ba-b787-bacf37c2838b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:11:02.691959 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Attempting to bind port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f on network 6fdf215c-4b9a-4c97-8019-724657b01fd2 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:11:02.696791 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f on network 6fdf215c-4b9a-4c97-8019-724657b01fd2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:11:02.697107 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Attempting to bind port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f on network 6fdf215c-4b9a-4c97-8019-724657b01fd2 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:11:02.701935 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 10, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:11:02.702482 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Checking segment: {'id': '1084bb90-956a-41ba-b787-bacf37c2838b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:11:02.703200 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Bound using segment: {'id': '1084bb90-956a-41ba-b787-bacf37c2838b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:11:02.703902 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Bound port: 0aa8ac82-7edc-488b-bd41-d51f5882ec5f, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1084bb90-956a-41ba-b787-bacf37c2838b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:11:02.704292 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:02.779569 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] For port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:11:02.782468 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] For port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=0aa8ac82-7edc-488b-bd41-d51f5882ec5f,segment=NetworkSegment(1084bb90-956a-41ba-b787-bacf37c2838b),segment_id=1084bb90-956a-41ba-b787-bacf37c2838b)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:11:02.843106 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:02.845115 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6ce75bf7-9f26-4371-b59d-c06b3f5ef190 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:02.879733 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:02.880335 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:02.881682 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] 10.222.0.25 "PUT /v2.0/ports/0aa8ac82-7edc-488b-bd41-d51f5882ec5f HTTP/1.1" status: 200 len: 1094 time: 0.7663498 Jun 17 11:11:02.882182 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d', 'tag': '0aa8ac82-7edc-488b-bd41-d51f5882ec5f'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:11:02.884743 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0c01035b-4fd2-4047-8677-80613de4325d" -d '{"events": [{"name": "network-changed", "server_uuid": "43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d", "tag": "0aa8ac82-7edc-488b-bd41-d51f5882ec5f"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:11:02.906580 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Pushing event updated for resources: {'Port': ['ID=0aa8ac82-7edc-488b-bd41-d51f5882ec5f,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:02.909752 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-7fc6f249-d6c7-47e8-8eb0-fdab585f222d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:02.919464 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:11:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82299329-14c0-4ae4-820e-7b1e21168781 x-openstack-request-id: req-82299329-14c0-4ae4-820e-7b1e21168781 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:11:02.919788 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d", "tag": "0aa8ac82-7edc-488b-bd41-d51f5882ec5f", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:11:02.920078 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-82299329-14c0-4ae4-820e-7b1e21168781 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:11:02.920510 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d', 'tag': '0aa8ac82-7edc-488b-bd41-d51f5882ec5f', 'status': 'completed', 'code': 200} Jun 17 11:11:03.000079 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c01035b-4fd2-4047-8677-80613de4325d req-41473fbb-6517-4a8b-96f9-853caafda1ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:03.001529 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0c01035b-4fd2-4047-8677-80613de4325d req-41473fbb-6517-4a8b-96f9-853caafda1ac service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=2cebe420e11c4e19890964552961967d&device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 1097 time: 0.0570138 Jun 17 11:11:03.101916 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c01035b-4fd2-4047-8677-80613de4325d req-0083fa15-b8af-4485-84aa-3f11c83d8af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:03.103376 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0c01035b-4fd2-4047-8677-80613de4325d req-0083fa15-b8af-4485-84aa-3f11c83d8af5 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=2cebe420e11c4e19890964552961967d&shared=False HTTP/1.1" status: 200 len: 909 time: 0.0936248 Jun 17 11:11:03.201926 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c01035b-4fd2-4047-8677-80613de4325d req-ac7c7347-fa80-44e4-ad46-6ca6cd491c7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:03.203398 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0c01035b-4fd2-4047-8677-80613de4325d req-ac7c7347-fa80-44e4-ad46-6ca6cd491c7d service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0914862 Jun 17 11:11:03.291645 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e23dcb8b-639a-4157-b304-56cb8578ec90 req-6b88e490-9965-4111-8b93-3d1877e9e08d tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:03.293166 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e23dcb8b-639a-4157-b304-56cb8578ec90 req-6b88e490-9965-4111-8b93-3d1877e9e08d tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 944 time: 0.0889070 Jun 17 11:11:03.341871 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-4111cd8c-087c-41fc-8c4f-30fe07801ab9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:03.343344 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-4111cd8c-087c-41fc-8c4f-30fe07801ab9 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=2cebe420e11c4e19890964552961967d&device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 1097 time: 0.0980093 Jun 17 11:11:03.346135 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e23dcb8b-639a-4157-b304-56cb8578ec90 req-c7d031bc-37ab-442f-beb5-74720d6f7984 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471747 Jun 17 11:11:03.387526 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-a0fbbcfd-dfe5-4b7e-9fbd-27794b37667d service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0aa8ac82-7edc-488b-bd41-d51f5882ec5f HTTP/1.1" status: 200 len: 217 time: 0.0334430 Jun 17 11:11:03.439734 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-97c70188-3e68-4f3a-8475-0185d4b0507f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:03.441197 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-97c70188-3e68-4f3a-8475-0185d4b0507f service neutron] 10.222.0.25 "GET /v2.0/subnets?id=5bd26c6d-2b2f-4a7b-b155-776ce9574191 HTTP/1.1" status: 200 len: 848 time: 0.0467503 Jun 17 11:11:03.474211 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-d8098438-097b-42ab-aae3-0f634d5b7e10 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=6fdf215c-4b9a-4c97-8019-724657b01fd2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0261378 Jun 17 11:11:03.566286 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-789333a5-5629-4116-ba7a-d58ce9c6671a service neutron] 10.222.0.25 "GET /v2.0/networks/6fdf215c-4b9a-4c97-8019-724657b01fd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831916 Jun 17 11:11:03.658765 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b5ed8c4b-3657-4878-b846-0792088ed4d0 req-3618a846-bef4-4337-a52f-11bf3f3597e0 service neutron] 10.222.0.25 "GET /v2.0/networks/6fdf215c-4b9a-4c97-8019-724657b01fd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852618 Jun 17 11:11:04.552345 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3358fe75-9ee8-4c70-b71e-fabc90abebe9 req-46d5fd25-ec83-41a3-a5bf-7e9f16116b7b tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:04.554355 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3358fe75-9ee8-4c70-b71e-fabc90abebe9 req-46d5fd25-ec83-41a3-a5bf-7e9f16116b7b tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 944 time: 0.0711372 Jun 17 11:11:04.591611 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3358fe75-9ee8-4c70-b71e-fabc90abebe9 req-c82a397d-f2be-46bb-b716-3cbb4d332594 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314591 Jun 17 11:11:05.769489 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc7822f-827e-41a6-abd1-3c71f74be1ce req-628bdc65-cb07-48c5-8f3b-b31a407cb294 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:05.771670 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0bc7822f-827e-41a6-abd1-3c71f74be1ce req-628bdc65-cb07-48c5-8f3b-b31a407cb294 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 944 time: 0.0702634 Jun 17 11:11:05.808833 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0bc7822f-827e-41a6-abd1-3c71f74be1ce req-8898e4ef-3d19-421b-a098-027770a550af tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316565 Jun 17 11:11:06.901079 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 0aa8ac82-7edc-488b-bd41-d51f5882ec5f details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:11:06.986920 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ec1ada-6c47-4c52-a455-32142e3fddd1 req-c168eb21-c7d6-4620-8319-ad3edaff8821 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:06.988896 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-72ec1ada-6c47-4c52-a455-32142e3fddd1 req-c168eb21-c7d6-4620-8319-ad3edaff8821 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 944 time: 0.0678399 Jun 17 11:11:06.997339 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=0aa8ac82-7edc-488b-bd41-d51f5882ec5f,segment=NetworkSegment(1084bb90-956a-41ba-b787-bacf37c2838b),segment_id=1084bb90-956a-41ba-b787-bacf37c2838b)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:11:07.012963 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '0aa8ac82-7edc-488b-bd41-d51f5882ec5f', 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2', 'port_id': '0aa8ac82-7edc-488b-bd41-d51f5882ec5f', 'mac_address': 'fa:16:3e:4d:3a:5b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 110, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5bd26c6d-2b2f-4a7b-b155-776ce9574191', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:11:07.026982 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-72ec1ada-6c47-4c52-a455-32142e3fddd1 req-cc6170f0-3f8b-4f13-9135-758a4c965697 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324454 Jun 17 11:11:07.049656 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:07.062585 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0aa8ac82-7edc-488b-bd41-d51f5882ec5f {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:11:07.081973 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=0aa8ac82-7edc-488b-bd41-d51f5882ec5f,segment=NetworkSegment(1084bb90-956a-41ba-b787-bacf37c2838b),segment_id=1084bb90-956a-41ba-b787-bacf37c2838b)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:11:07.165956 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:07.167768 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:07.213781 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=0aa8ac82-7edc-488b-bd41-d51f5882ec5f,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:07.216878 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:07.687404 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['0aa8ac82-7edc-488b-bd41-d51f5882ec5f'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:11:07.710335 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:08.196650 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-127909bb-e34f-4259-a468-4c2ab8d5af15 req-d5ac9020-415f-4f65-8477-ed7cdeeb1f61 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:08.198092 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-127909bb-e34f-4259-a468-4c2ab8d5af15 req-d5ac9020-415f-4f65-8477-ed7cdeeb1f61 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 945 time: 0.0626807 Jun 17 11:11:08.234476 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-127909bb-e34f-4259-a468-4c2ab8d5af15 req-7a644d43-32ac-43ce-af0a-34a3c1ab4267 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304248 Jun 17 11:11:08.940464 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 0aa8ac82-7edc-488b-bd41-d51f5882ec5f up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:11:09.082609 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:11:09.087118 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:11:09.087497 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:09.168378 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:09.193434 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0aa8ac82-7edc-488b-bd41-d51f5882ec5f'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:11:09.196462 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22c76454-3b23-4344-b2a6-24b15a1fa250" -d '{"events": [{"server_uuid": "43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d", "name": "network-vif-plugged", "status": "completed", "tag": "0aa8ac82-7edc-488b-bd41-d51f5882ec5f"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:11:09.211746 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=0aa8ac82-7edc-488b-bd41-d51f5882ec5f,segment=NetworkSegment(1084bb90-956a-41ba-b787-bacf37c2838b),segment_id=1084bb90-956a-41ba-b787-bacf37c2838b)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:11:09.237374 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:11:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7ec2555-78cc-4cf8-93d9-2b2987fed866 x-openstack-request-id: req-a7ec2555-78cc-4cf8-93d9-2b2987fed866 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:11:09.237674 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d", "name": "network-vif-plugged", "status": "completed", "tag": "0aa8ac82-7edc-488b-bd41-d51f5882ec5f", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:11:09.237929 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-a7ec2555-78cc-4cf8-93d9-2b2987fed866 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:11:09.238332 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0aa8ac82-7edc-488b-bd41-d51f5882ec5f', 'code': 200} Jun 17 11:11:09.301031 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:09.305454 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:09.354974 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=0aa8ac82-7edc-488b-bd41-d51f5882ec5f,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:09.358247 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:09.419311 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27f81c6a-723a-4fd3-a974-c3d7ae1f05a2 req-b8791ec2-ebbe-435a-888d-82371a3125bd tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:09.420892 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-27f81c6a-723a-4fd3-a974-c3d7ae1f05a2 req-b8791ec2-ebbe-435a-888d-82371a3125bd tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 946 time: 0.0694556 Jun 17 11:11:09.462528 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-27f81c6a-723a-4fd3-a974-c3d7ae1f05a2 req-9473ad85-4f7b-4e15-8b5c-74ebd6ff5f25 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358636 Jun 17 11:11:09.605571 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba0d2252-b0ac-4b4f-81b2-7e87471ae529 req-48682040-db4d-41e1-a753-afe73592e70e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:09.607074 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba0d2252-b0ac-4b4f-81b2-7e87471ae529 req-48682040-db4d-41e1-a753-afe73592e70e service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 1099 time: 0.0506697 Jun 17 11:11:09.641161 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba0d2252-b0ac-4b4f-81b2-7e87471ae529 req-a4410d9c-7bab-44a1-8957-9f2d728c97e1 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0270081 Jun 17 11:11:10.630487 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fb7bf4c-d596-421a-a32e-2820707c1a16 req-4a06e9d8-da1d-40e3-a5bf-d1910f8fb858 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:10.631930 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3fb7bf4c-d596-421a-a32e-2820707c1a16 req-4a06e9d8-da1d-40e3-a5bf-d1910f8fb858 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 946 time: 0.0604362 Jun 17 11:11:10.668726 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3fb7bf4c-d596-421a-a32e-2820707c1a16 req-52fbee42-4c2d-4514-a018-f6f39d5b3301 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309222 Jun 17 11:11:11.842097 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0a6a18-671b-49b5-93df-954bed72645e req-75b78fb1-f2f3-4e86-aa38-28b97825fb61 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:11.843559 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ae0a6a18-671b-49b5-93df-954bed72645e req-75b78fb1-f2f3-4e86-aa38-28b97825fb61 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 946 time: 0.0652168 Jun 17 11:11:11.880397 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ae0a6a18-671b-49b5-93df-954bed72645e req-327768eb-52fd-4b87-8736-6731e5539096 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312672 Jun 17 11:11:13.503651 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9c892ec-6106-4070-8eb1-c81cb6c1afef req-03acd41e-4239-4126-b2c3-5f0b916ca06b tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:13.505097 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f9c892ec-6106-4070-8eb1-c81cb6c1afef req-03acd41e-4239-4126-b2c3-5f0b916ca06b tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 946 time: 0.0650313 Jun 17 11:11:13.542370 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f9c892ec-6106-4070-8eb1-c81cb6c1afef req-caf26cc5-f427-423a-89ee-fe1f3252f538 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313132 Jun 17 11:11:14.721062 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-822f6815-bc0f-48fd-b997-6ee7fcd76cf8 req-2fa4dfa5-645a-47cf-be57-95712ef6cbda tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:14.722497 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-822f6815-bc0f-48fd-b997-6ee7fcd76cf8 req-2fa4dfa5-645a-47cf-be57-95712ef6cbda tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 946 time: 0.0687444 Jun 17 11:11:14.762620 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-822f6815-bc0f-48fd-b997-6ee7fcd76cf8 req-43f41261-aa5b-4bd9-b7cb-4b8841d72884 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0345366 Jun 17 11:11:15.592949 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd87ccc3-59f6-49eb-89e1-f6a5e5bf4181 req-18a2d4c3-2afe-4d04-a2b2-026ddd7893c5 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:15.594356 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bd87ccc3-59f6-49eb-89e1-f6a5e5bf4181 req-18a2d4c3-2afe-4d04-a2b2-026ddd7893c5 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.25 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 946 time: 0.0625386 Jun 17 11:11:15.695591 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-bd87ccc3-59f6-49eb-89e1-f6a5e5bf4181 req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Deleting port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:11:15.695958 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bd87ccc3-59f6-49eb-89e1-f6a5e5bf4181 req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:15.786680 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-bd87ccc3-59f6-49eb-89e1-f6a5e5bf4181 req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] For port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=0aa8ac82-7edc-488b-bd41-d51f5882ec5f,segment=NetworkSegment(1084bb90-956a-41ba-b787-bacf37c2838b),segment_id=1084bb90-956a-41ba-b787-bacf37c2838b)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:11:15.787080 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bd87ccc3-59f6-49eb-89e1-f6a5e5bf4181 req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:15.854932 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-bd87ccc3-59f6-49eb-89e1-f6a5e5bf4181 req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Calling delete_port for 0aa8ac82-7edc-488b-bd41-d51f5882ec5f owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:11:15.936750 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014a105b-58e1-4418-896d-38d04ef9aca7 req-0480be94-1b02-418c-8cb3-69cb5ea95eb4 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:15.938213 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-014a105b-58e1-4418-896d-38d04ef9aca7 req-0480be94-1b02-418c-8cb3-69cb5ea95eb4 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 946 time: 0.0661194 Jun 17 11:11:15.978963 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-014a105b-58e1-4418-896d-38d04ef9aca7 req-64ae2a4e-7a5b-4984-9a27-97c3497dbeef tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350032 Jun 17 11:11:16.105814 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bd87ccc3-59f6-49eb-89e1-f6a5e5bf4181 req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:16.111031 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-166f5bae-616d-429c-b31f-5c548ff554b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:16.118064 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['0aa8ac82-7edc-488b-bd41-d51f5882ec5f'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:11:16.149239 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Pushing event deleted for resources: {'Port': ['ID=0aa8ac82-7edc-488b-bd41-d51f5882ec5f,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:16.175555 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.175892 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.177111 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.177500 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.177869 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.178234 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.178967 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.179655 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.180098 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.180389 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.180749 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.181105 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:11:16.185345 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:16.204160 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-bd87ccc3-59f6-49eb-89e1-f6a5e5bf4181 req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] No DVR routers for this DVR port 0aa8ac82-7edc-488b-bd41-d51f5882ec5f on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:11:16.207047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-bd87ccc3-59f6-49eb-89e1-f6a5e5bf4181 req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:16.209234 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bd87ccc3-59f6-49eb-89e1-f6a5e5bf4181 req-0bf10956-98f4-4e64-a6a7-d7481b0a480c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.25 "DELETE /v2.0/ports/0aa8ac82-7edc-488b-bd41-d51f5882ec5f HTTP/1.1" status: 204 len: 173 time: 0.6088324 Jun 17 11:11:16.209798 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d', 'name': 'network-vif-deleted', 'tag': '0aa8ac82-7edc-488b-bd41-d51f5882ec5f'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:11:16.212272 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e29f4908-72b0-444d-beef-3134a92b868e" -d '{"events": [{"server_uuid": "43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d", "name": "network-vif-deleted", "tag": "0aa8ac82-7edc-488b-bd41-d51f5882ec5f"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:11:16.247291 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:11:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec94175d-d897-4c17-8b84-02e434fc2acd x-openstack-request-id: req-ec94175d-d897-4c17-8b84-02e434fc2acd {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:11:16.247625 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d", "name": "network-vif-deleted", "tag": "0aa8ac82-7edc-488b-bd41-d51f5882ec5f", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:11:16.247932 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-ec94175d-d897-4c17-8b84-02e434fc2acd {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:11:16.248376 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d', 'name': 'network-vif-deleted', 'tag': '0aa8ac82-7edc-488b-bd41-d51f5882ec5f', 'status': 'completed', 'code': 200} Jun 17 11:11:17.138712 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-62457a2e-ffbd-498f-b217-7154a5cdf844 req-70899ea5-fde6-4716-89d3-d61e149d1179 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=43b3e1d3-c7ca-4fbe-b5e2-09d41cec853d HTTP/1.1" status: 200 len: 210 time: 0.0325189 Jun 17 11:11:18.442213 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e2464e-f550-4896-99c0-b60422522264 req-2377274a-8011-4963-aa22-135b054bee6d tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:18.443724 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-2377274a-8011-4963-aa22-135b054bee6d tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/networks?id=6fdf215c-4b9a-4c97-8019-724657b01fd2 HTTP/1.1" status: 200 len: 808 time: 0.1104512 Jun 17 11:11:18.459458 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-fd5328f2-b9ef-4773-b076-0c0e15b15a04 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/quotas/2cebe420e11c4e19890964552961967d HTTP/1.1" status: 200 len: 375 time: 0.0096028 Jun 17 11:11:18.496772 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-06742cb1-5793-4c98-8e68-4a2920c4457a tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=2cebe420e11c4e19890964552961967d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0324543 Jun 17 11:11:18.583216 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-89477d20-d2a9-49e5-8f41-3d250b4ef396 service neutron] 10.222.0.41 "GET /v2.0/networks/6fdf215c-4b9a-4c97-8019-724657b01fd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0799048 Jun 17 11:11:18.672360 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-e4c19a3a-c5dc-4170-a039-5b7dd66504be service neutron] 10.222.0.41 "GET /v2.0/networks/6fdf215c-4b9a-4c97-8019-724657b01fd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834615 Jun 17 11:11:18.927725 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ad79e5d9-7d00-4c2a-afb9-79bfc168ec2c req-767a8467-66de-4b95-91c3-ca4213b15e11 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 210 time: 0.0288584 Jun 17 11:11:18.986973 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 0aa8ac82-7edc-488b-bd41-d51f5882ec5f no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:11:19.007389 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 0aa8ac82-7edc-488b-bd41-d51f5882ec5f {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:11:19.007753 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 0aa8ac82-7edc-488b-bd41-d51f5882ec5f not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:11:20.064715 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-664de48e-a0f0-42de-a7e4-d625ee566776 req-d2647998-1dc9-41aa-9980-8cc3024ab89a tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 210 time: 0.0284476 Jun 17 11:11:20.705848 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8ac0babf-2cad-489a-9b34-990f3bcbc7d6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:21.071731 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e2464e-f550-4896-99c0-b60422522264 req-61d20003-3bc9-488f-91cf-464ef69f75ff tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:21.073578 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-61d20003-3bc9-488f-91cf-464ef69f75ff tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.25 "GET /v2.0/networks?id=6fdf215c-4b9a-4c97-8019-724657b01fd2 HTTP/1.1" status: 200 len: 808 time: 0.1000822 Jun 17 11:11:21.086944 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Request body: {'port': {'device_id': 'a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201', 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2', 'admin_state_up': True, 'tenant_id': '2cebe420e11c4e19890964552961967d'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:11:21.223032 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-fcb9a3a5-3ff7-4c96-b816-b164dec3316b req-bdd41c50-c0c6-45c3-81ec-4fc5a73a231a tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 210 time: 0.0370433 Jun 17 11:11:21.282576 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Made reservation on behalf of 2cebe420e11c4e19890964552961967d for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:11:21.286240 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:21.416373 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Allocated IP 172.20.0.12 (6fdf215c-4b9a-4c97-8019-724657b01fd2/5bd26c6d-2b2f-4a7b-b155-776ce9574191/89cec8ad-b38f-49ab-bae7-05575026439b) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:11:21.575386 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:21.698219 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:21.703047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cfd2b2c4-ba50-4251-b0ab-ea1f5c7bde37 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:21.745188 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Network 6fdf215c-4b9a-4c97-8019-724657b01fd2 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:11:21.748410 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:11:21.750825 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:11:21.797272 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Pushing event updated for resources: {'Port': ['ID=89cec8ad-b38f-49ab-bae7-05575026439b,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:21.800786 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:21.839118 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:21.839788 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:21.915938 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8328218 Jun 17 11:11:21.929090 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Request body: {'port': {'device_id': 'a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:11:22.005896 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:22.297428 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 89cec8ad-b38f-49ab-bae7-05575026439b {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:11:22.304994 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:22.317215 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Transition to ACTIVE for port object 89cec8ad-b38f-49ab-bae7-05575026439b will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:11:22.400207 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2780b9b9-5fe8-44fa-a389-6374d2d9e132 req-f5c6d278-0e07-4443-a96b-132397f65916 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:22.402360 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2780b9b9-5fe8-44fa-a389-6374d2d9e132 req-f5c6d278-0e07-4443-a96b-132397f65916 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 932 time: 0.0632598 Jun 17 11:11:22.403523 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:22.405676 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4596692b-2ea5-4c46-8354-c405a863f9b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:22.503516 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Pushing event updated for resources: {'Port': ['ID=89cec8ad-b38f-49ab-bae7-05575026439b,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:22.508265 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:22.514981 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2780b9b9-5fe8-44fa-a389-6374d2d9e132 req-5be2ecd2-10fd-49a4-9de2-0a0c1aff769d tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1062834 Jun 17 11:11:22.580430 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Attempting to bind port 89cec8ad-b38f-49ab-bae7-05575026439b on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:11:22.580766 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Attempting to bind port 89cec8ad-b38f-49ab-bae7-05575026439b by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': '1084bb90-956a-41ba-b787-bacf37c2838b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:11:22.581095 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Attempting to bind port 89cec8ad-b38f-49ab-bae7-05575026439b on network 6fdf215c-4b9a-4c97-8019-724657b01fd2 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:11:22.585753 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Port 89cec8ad-b38f-49ab-bae7-05575026439b on network 6fdf215c-4b9a-4c97-8019-724657b01fd2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:11:22.586071 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Attempting to bind port 89cec8ad-b38f-49ab-bae7-05575026439b on network 6fdf215c-4b9a-4c97-8019-724657b01fd2 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:11:22.592067 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 11, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:11:22.592405 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Checking segment: {'id': '1084bb90-956a-41ba-b787-bacf37c2838b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:11:22.592786 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Bound using segment: {'id': '1084bb90-956a-41ba-b787-bacf37c2838b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:11:22.593210 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Bound port: 89cec8ad-b38f-49ab-bae7-05575026439b, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1084bb90-956a-41ba-b787-bacf37c2838b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:11:22.599674 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:22.657390 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] For port 89cec8ad-b38f-49ab-bae7-05575026439b, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:11:22.660589 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] For port 89cec8ad-b38f-49ab-bae7-05575026439b, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=89cec8ad-b38f-49ab-bae7-05575026439b,segment=NetworkSegment(1084bb90-956a-41ba-b787-bacf37c2838b),segment_id=1084bb90-956a-41ba-b787-bacf37c2838b)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:11:22.729490 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:22.731846 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-cf145273-48fd-4487-902a-e641d32b5c20 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:22.767558 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:22.768170 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:22.769520 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] 10.222.0.25 "PUT /v2.0/ports/89cec8ad-b38f-49ab-bae7-05575026439b HTTP/1.1" status: 200 len: 1094 time: 0.8448079 Jun 17 11:11:22.770042 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201', 'tag': '89cec8ad-b38f-49ab-bae7-05575026439b'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:11:22.772447 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a2cbf7f7-e89e-4eea-ba58-013ce3d08a1c" -d '{"events": [{"name": "network-changed", "server_uuid": "a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201", "tag": "89cec8ad-b38f-49ab-bae7-05575026439b"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:11:22.796700 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Pushing event updated for resources: {'Port': ['ID=89cec8ad-b38f-49ab-bae7-05575026439b,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:22.799857 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-838acd7b-7d4f-4ff0-bb2d-5e2bf8e80f9c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:22.824675 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:11:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6563141-bce2-422d-b408-e892d733e1f1 x-openstack-request-id: req-b6563141-bce2-422d-b408-e892d733e1f1 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:11:22.825135 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201", "tag": "89cec8ad-b38f-49ab-bae7-05575026439b", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:11:22.825524 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-b6563141-bce2-422d-b408-e892d733e1f1 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:11:22.826038 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201', 'tag': '89cec8ad-b38f-49ab-bae7-05575026439b', 'status': 'completed', 'code': 200} Jun 17 11:11:22.905314 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2cbf7f7-e89e-4eea-ba58-013ce3d08a1c req-d42845b5-1bf6-49ae-860c-eae7d54a1f24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:22.906904 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a2cbf7f7-e89e-4eea-ba58-013ce3d08a1c req-d42845b5-1bf6-49ae-860c-eae7d54a1f24 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=2cebe420e11c4e19890964552961967d&device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 1097 time: 0.0559556 Jun 17 11:11:23.013307 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2cbf7f7-e89e-4eea-ba58-013ce3d08a1c req-512d4dae-3979-4487-b86e-594fc7990455 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:23.014764 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a2cbf7f7-e89e-4eea-ba58-013ce3d08a1c req-512d4dae-3979-4487-b86e-594fc7990455 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=2cebe420e11c4e19890964552961967d&shared=False HTTP/1.1" status: 200 len: 909 time: 0.0969579 Jun 17 11:11:23.126466 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2cbf7f7-e89e-4eea-ba58-013ce3d08a1c req-ccdcb628-cfc2-4ffc-81ca-432b6c170ca8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:23.128042 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a2cbf7f7-e89e-4eea-ba58-013ce3d08a1c req-ccdcb628-cfc2-4ffc-81ca-432b6c170ca8 service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0934496 Jun 17 11:11:23.229332 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e2464e-f550-4896-99c0-b60422522264 req-92352f92-e041-4822-9c8a-fe6ce0b682dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:23.231221 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-92352f92-e041-4822-9c8a-fe6ce0b682dc service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=2cebe420e11c4e19890964552961967d&device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 1097 time: 0.0604470 Jun 17 11:11:23.277109 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-1ca63d5b-deca-4dd3-83e4-b0978bd219fa service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=89cec8ad-b38f-49ab-bae7-05575026439b HTTP/1.1" status: 200 len: 217 time: 0.0380874 Jun 17 11:11:23.327768 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e2464e-f550-4896-99c0-b60422522264 req-ebf604bb-f1b1-4fa2-8ffe-42c5d480f33a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:23.329007 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-ebf604bb-f1b1-4fa2-8ffe-42c5d480f33a service neutron] 10.222.0.25 "GET /v2.0/subnets?id=5bd26c6d-2b2f-4a7b-b155-776ce9574191 HTTP/1.1" status: 200 len: 848 time: 0.0438204 Jun 17 11:11:23.348242 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d9e6fb09-26fd-40a6-8c49-4dbcf493fa89 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:23.362381 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-d1d4db5c-10fa-4529-9a3f-ee02bc7ef02b service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=6fdf215c-4b9a-4c97-8019-724657b01fd2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0259204 Jun 17 11:11:23.454550 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-4ed2232d-aba8-446c-8a7e-2e61960f6ec1 service neutron] 10.222.0.25 "GET /v2.0/networks/6fdf215c-4b9a-4c97-8019-724657b01fd2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852644 Jun 17 11:11:23.545226 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f3e2464e-f550-4896-99c0-b60422522264 req-46efb1a6-1807-4415-9689-5515f1f15ae3 service neutron] 10.222.0.25 "GET /v2.0/networks/6fdf215c-4b9a-4c97-8019-724657b01fd2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838995 Jun 17 11:11:23.593995 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:23.709751 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ffbc64-d5c2-44b1-8290-d7b9c3dd56dc req-bd1636bc-467e-4162-a99a-88dfa545bba3 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:23.711222 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-92ffbc64-d5c2-44b1-8290-d7b9c3dd56dc req-bd1636bc-467e-4162-a99a-88dfa545bba3 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 944 time: 0.0624490 Jun 17 11:11:23.748569 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-92ffbc64-d5c2-44b1-8290-d7b9c3dd56dc req-c741eef2-d0eb-49e1-a4ed-8c1e413b4912 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315912 Jun 17 11:11:24.488466 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:24.914741 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2435e32d-9c00-47d0-bbde-cc6cd82c0709 req-0235c303-3eba-4d6d-b433-1ae715a8a49e tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:24.916883 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2435e32d-9c00-47d0-bbde-cc6cd82c0709 req-0235c303-3eba-4d6d-b433-1ae715a8a49e tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 944 time: 0.0604718 Jun 17 11:11:24.952632 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-2435e32d-9c00-47d0-bbde-cc6cd82c0709 req-1b9c5bc7-f510-4ea6-bf80-62fb2755da95 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302608 Jun 17 11:11:26.124267 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c979bab-840a-44dc-926b-ea95c7ec4a2e req-32eaa67c-6ec9-4125-90c9-6b2cd35c1fbb tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:26.125703 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6c979bab-840a-44dc-926b-ea95c7ec4a2e req-32eaa67c-6ec9-4125-90c9-6b2cd35c1fbb tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 944 time: 0.0646183 Jun 17 11:11:26.161027 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6c979bab-840a-44dc-926b-ea95c7ec4a2e req-789c962f-92d7-42a6-8a98-53830e304954 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0298300 Jun 17 11:11:26.836835 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:27.051162 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 89cec8ad-b38f-49ab-bae7-05575026439b details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:11:27.141586 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 89cec8ad-b38f-49ab-bae7-05575026439b, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=89cec8ad-b38f-49ab-bae7-05575026439b,segment=NetworkSegment(1084bb90-956a-41ba-b787-bacf37c2838b),segment_id=1084bb90-956a-41ba-b787-bacf37c2838b)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:11:27.152567 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '89cec8ad-b38f-49ab-bae7-05575026439b', 'network_id': '6fdf215c-4b9a-4c97-8019-724657b01fd2', 'port_id': '89cec8ad-b38f-49ab-bae7-05575026439b', 'mac_address': 'fa:16:3e:2a:a4:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 110, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5bd26c6d-2b2f-4a7b-b155-776ce9574191', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:11:27.191023 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:27.203256 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 89cec8ad-b38f-49ab-bae7-05575026439b {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:11:27.222349 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 89cec8ad-b38f-49ab-bae7-05575026439b, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=89cec8ad-b38f-49ab-bae7-05575026439b,segment=NetworkSegment(1084bb90-956a-41ba-b787-bacf37c2838b),segment_id=1084bb90-956a-41ba-b787-bacf37c2838b)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:11:27.299576 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:27.301373 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-3ac3614e-f993-4cb1-9ec1-893fead06411 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:27.333074 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0d50153-6729-4893-a59a-329e538f3376 req-2ff9ef62-3580-4d45-bc1f-73d9a6a0aee4 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:27.334600 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a0d50153-6729-4893-a59a-329e538f3376 req-2ff9ef62-3580-4d45-bc1f-73d9a6a0aee4 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 944 time: 0.0641153 Jun 17 11:11:27.347348 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=89cec8ad-b38f-49ab-bae7-05575026439b,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:27.350387 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:27.372097 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a0d50153-6729-4893-a59a-329e538f3376 req-c4b0fbda-6d3f-44ee-b0b9-a1ad30c5c834 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317056 Jun 17 11:11:27.665982 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['89cec8ad-b38f-49ab-bae7-05575026439b'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:11:28.552878 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f04c1b-83e7-4829-892d-368ed205c780 req-dc2b5118-0ce9-49e0-8fa3-c7a24f43690a tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:28.554331 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-37f04c1b-83e7-4829-892d-368ed205c780 req-dc2b5118-0ce9-49e0-8fa3-c7a24f43690a tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 945 time: 0.0710742 Jun 17 11:11:28.592068 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-37f04c1b-83e7-4829-892d-368ed205c780 req-6085e21a-2424-48c7-9556-c08c6eb28298 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315001 Jun 17 11:11:29.049239 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 89cec8ad-b38f-49ab-bae7-05575026439b up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:11:29.144803 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 89cec8ad-b38f-49ab-bae7-05575026439b completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:11:29.148425 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 89cec8ad-b38f-49ab-bae7-05575026439b triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:11:29.148808 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:29.221564 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:29.243050 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '89cec8ad-b38f-49ab-bae7-05575026439b'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:11:29.245884 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-326eb644-a82d-40b5-af65-ae4dc0ac8595" -d '{"events": [{"server_uuid": "a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201", "name": "network-vif-plugged", "status": "completed", "tag": "89cec8ad-b38f-49ab-bae7-05575026439b"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:11:29.258060 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 89cec8ad-b38f-49ab-bae7-05575026439b, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=89cec8ad-b38f-49ab-bae7-05575026439b,segment=NetworkSegment(1084bb90-956a-41ba-b787-bacf37c2838b),segment_id=1084bb90-956a-41ba-b787-bacf37c2838b)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:11:29.281508 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:11:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60887c9c-2fa1-458d-86db-fb73fb55c599 x-openstack-request-id: req-60887c9c-2fa1-458d-86db-fb73fb55c599 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:11:29.281832 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201", "name": "network-vif-plugged", "status": "completed", "tag": "89cec8ad-b38f-49ab-bae7-05575026439b", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:11:29.282114 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-60887c9c-2fa1-458d-86db-fb73fb55c599 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:11:29.282516 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '89cec8ad-b38f-49ab-bae7-05575026439b', 'code': 200} Jun 17 11:11:29.328210 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:29.330779 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:29.380012 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=89cec8ad-b38f-49ab-bae7-05575026439b,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:29.382995 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:29.644115 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45040120-f8f7-4348-ade4-41da83e02c5f req-b2ef6109-5c8d-4545-9437-58a75867029d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:29.645571 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-45040120-f8f7-4348-ade4-41da83e02c5f req-b2ef6109-5c8d-4545-9437-58a75867029d service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 1099 time: 0.0552521 Jun 17 11:11:29.685439 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-45040120-f8f7-4348-ade4-41da83e02c5f req-80b33b33-2cc8-419a-9c62-e1a4e7c2609b service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0286114 Jun 17 11:11:29.774321 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d87e5d4-2e1e-4f4a-82b2-674960984a34 req-2d5ca627-7e07-4cc1-bb90-5d0ea235505c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:29.776399 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1d87e5d4-2e1e-4f4a-82b2-674960984a34 req-2d5ca627-7e07-4cc1-bb90-5d0ea235505c tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 946 time: 0.0628736 Jun 17 11:11:29.812301 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1d87e5d4-2e1e-4f4a-82b2-674960984a34 req-cd5826f4-4ca1-44b5-90cd-984b9d1c708a tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304053 Jun 17 11:11:30.042369 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:11:30.981906 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f38cbc3-5978-48f6-88b3-9cd2861e8649 req-57cc77ac-78ee-4d0f-a459-fde4ce681797 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:30.983457 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4f38cbc3-5978-48f6-88b3-9cd2861e8649 req-57cc77ac-78ee-4d0f-a459-fde4ce681797 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 946 time: 0.0631499 Jun 17 11:11:31.024796 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4f38cbc3-5978-48f6-88b3-9cd2861e8649 req-f046927d-45f9-4f23-99c8-e7eaebc91622 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353296 Jun 17 11:11:32.195113 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eccd399-53c3-470f-a776-ac3e87eec30c req-d07dc8dd-be95-4ab4-9224-7c5169a604de tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:32.196557 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3eccd399-53c3-470f-a776-ac3e87eec30c req-d07dc8dd-be95-4ab4-9224-7c5169a604de tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 946 time: 0.0640323 Jun 17 11:11:32.236994 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3eccd399-53c3-470f-a776-ac3e87eec30c req-d7a9cfe7-f7b3-4af9-b8bc-e51385078c58 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309591 Jun 17 11:11:33.610938 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3273163-f585-4954-a0b9-40454bde6c3c req-3fea7b5d-58cc-48a7-87a7-5c1b9d161b7a tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:33.612415 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a3273163-f585-4954-a0b9-40454bde6c3c req-3fea7b5d-58cc-48a7-87a7-5c1b9d161b7a tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 946 time: 0.0619273 Jun 17 11:11:33.649469 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a3273163-f585-4954-a0b9-40454bde6c3c req-711f5aa3-cf63-4797-b409-2f7de7c2cf2a tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314455 Jun 17 11:11:34.823167 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59bbd64e-c197-47ac-80de-23ac41f183a6 req-dec97f57-43cb-4982-b705-d14d3d74a7d3 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:34.824607 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-59bbd64e-c197-47ac-80de-23ac41f183a6 req-dec97f57-43cb-4982-b705-d14d3d74a7d3 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 946 time: 0.0651634 Jun 17 11:11:34.860347 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-59bbd64e-c197-47ac-80de-23ac41f183a6 req-f0fb7adf-a816-46a9-ab58-ff5e870cc4a2 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/security-groups?id=803c65cf-9f25-48a9-8169-d7775d8209a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0301609 Jun 17 11:11:35.240988 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97329c1f-9f74-4a68-90e4-26826f0b6dbf req-0b8dd781-5240-4152-942a-88bfde48eeee tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:35.242512 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-97329c1f-9f74-4a68-90e4-26826f0b6dbf req-0b8dd781-5240-4152-942a-88bfde48eeee tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.25 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 946 time: 0.0619571 Jun 17 11:11:35.348670 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-97329c1f-9f74-4a68-90e4-26826f0b6dbf req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Deleting port 89cec8ad-b38f-49ab-bae7-05575026439b {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:11:35.349011 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-97329c1f-9f74-4a68-90e4-26826f0b6dbf req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:35.432482 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-97329c1f-9f74-4a68-90e4-26826f0b6dbf req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] For port 89cec8ad-b38f-49ab-bae7-05575026439b, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=89cec8ad-b38f-49ab-bae7-05575026439b,segment=NetworkSegment(1084bb90-956a-41ba-b787-bacf37c2838b),segment_id=1084bb90-956a-41ba-b787-bacf37c2838b)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:11:35.433137 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-97329c1f-9f74-4a68-90e4-26826f0b6dbf req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:35.760959 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-97329c1f-9f74-4a68-90e4-26826f0b6dbf req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Calling delete_port for 89cec8ad-b38f-49ab-bae7-05575026439b owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:11:35.981240 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-97329c1f-9f74-4a68-90e4-26826f0b6dbf req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:35.993026 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['89cec8ad-b38f-49ab-bae7-05575026439b'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:11:36.000858 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d705eb2f-b48a-4f67-8799-11529fe4b7f6 req-599fde15-a10b-46dd-84fa-30ac1864fdff tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.41 "GET /v2.0/ports?device_id=a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201 HTTP/1.1" status: 200 len: 210 time: 0.0299623 Jun 17 11:11:36.001495 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5e954e3e-1a4e-434b-8e10-b0a89bba6a6f tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:11:36.027139 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Pushing event deleted for resources: {'Port': ['ID=89cec8ad-b38f-49ab-bae7-05575026439b,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:11:36.030288 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:11:36.070023 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-97329c1f-9f74-4a68-90e4-26826f0b6dbf req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] No DVR routers for this DVR port 89cec8ad-b38f-49ab-bae7-05575026439b on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:11:36.073308 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-97329c1f-9f74-4a68-90e4-26826f0b6dbf req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:36.075637 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-97329c1f-9f74-4a68-90e4-26826f0b6dbf req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] 10.222.0.25 "DELETE /v2.0/ports/89cec8ad-b38f-49ab-bae7-05575026439b HTTP/1.1" status: 204 len: 173 time: 0.8265109 Jun 17 11:11:36.076164 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201', 'name': 'network-vif-deleted', 'tag': '89cec8ad-b38f-49ab-bae7-05575026439b'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:11:36.079516 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4634c1f1-21e2-44a5-9ad1-acdfce564667" -d '{"events": [{"server_uuid": "a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201", "name": "network-vif-deleted", "tag": "89cec8ad-b38f-49ab-bae7-05575026439b"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:11:36.117221 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:11:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59b6fc1f-2f8a-47d7-9019-cda0e304fb11 x-openstack-request-id: req-59b6fc1f-2f8a-47d7-9019-cda0e304fb11 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:11:36.117549 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201", "name": "network-vif-deleted", "tag": "89cec8ad-b38f-49ab-bae7-05575026439b", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:11:36.117835 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-59b6fc1f-2f8a-47d7-9019-cda0e304fb11 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:11:36.118273 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a1b2e6ec-d2d7-41cc-b0dc-08ef4f3de201', 'name': 'network-vif-deleted', 'tag': '89cec8ad-b38f-49ab-bae7-05575026439b', 'status': 'completed', 'code': 200} Jun 17 11:11:37.750729 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:40.105748 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 89cec8ad-b38f-49ab-bae7-05575026439b no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:11:40.126453 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 89cec8ad-b38f-49ab-bae7-05575026439b {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:11:40.126807 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 89cec8ad-b38f-49ab-bae7-05575026439b not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:11:41.265588 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83661488-ece7-40ab-92e8-88a411c3add8 req-f4b4c2a2-674c-48e3-8959-d2d4e1a1999d service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0548575 Jun 17 11:11:42.804582 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83661488-ece7-40ab-92e8-88a411c3add8 req-d2db3b41-1582-4504-b911-4312f02ee0aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:42.806111 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83661488-ece7-40ab-92e8-88a411c3add8 req-d2db3b41-1582-4504-b911-4312f02ee0aa service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 1099 time: 0.0541477 Jun 17 11:11:42.909069 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83661488-ece7-40ab-92e8-88a411c3add8 req-08be0454-3f1c-4f69-b975-a5995d80dcda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:42.910460 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83661488-ece7-40ab-92e8-88a411c3add8 req-08be0454-3f1c-4f69-b975-a5995d80dcda service neutron] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 913 time: 0.0839369 Jun 17 11:11:42.971763 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83661488-ece7-40ab-92e8-88a411c3add8 req-523fa9fa-8a01-4f1b-b718-4d87dd9be1f0 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=05c3d654-1803-4edd-9ea3-44a8afd65285 HTTP/1.1" status: 200 len: 1002 time: 0.0546415 Jun 17 11:11:43.018444 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83661488-ece7-40ab-92e8-88a411c3add8 req-7270b259-268c-4d91-855f-2c3b5093f672 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:43.019841 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83661488-ece7-40ab-92e8-88a411c3add8 req-7270b259-268c-4d91-855f-2c3b5093f672 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0417619 Jun 17 11:11:43.077474 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83661488-ece7-40ab-92e8-88a411c3add8 req-ce9fd623-a8cd-459a-9ff2-c9d185e2b30c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:11:43.078918 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83661488-ece7-40ab-92e8-88a411c3add8 req-ce9fd623-a8cd-459a-9ff2-c9d185e2b30c service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0527978 Jun 17 11:11:43.165666 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83661488-ece7-40ab-92e8-88a411c3add8 req-ad1b1615-fa26-468d-942a-e614ade9f0b9 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788739 Jun 17 11:11:43.258138 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-83661488-ece7-40ab-92e8-88a411c3add8 req-2a5d3817-3bec-4c68-8f51-6fe169652fed service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829561 Jun 17 11:11:50.673689 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-40bffcde-aceb-4b7a-8156-c6bb21e86ff7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:53.333852 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-cb6457f6-4320-4889-9286-522912c8e0af None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:53.579619 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:54.494206 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:11:56.824888 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:03.526013 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42064) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:12:03.570909 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_v2 [None req-ae644f42-e978-4f48-88d9-e1c15806a1c0 admin admin] Deleting subnet 5bd26c6d-2b2f-4a7b-b155-776ce9574191 {{(pid=110215) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:12:03.573796 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ae644f42-e978-4f48-88d9-e1c15806a1c0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:03.606080 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ae644f42-e978-4f48-88d9-e1c15806a1c0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6032829'] for subnet, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:03.643312 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ae644f42-e978-4f48-88d9-e1c15806a1c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:03.755901 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ae644f42-e978-4f48-88d9-e1c15806a1c0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5898882', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5636066'] for subnet, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:03.757784 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:03.795910 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae644f42-e978-4f48-88d9-e1c15806a1c0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5bd26c6d-2b2f-4a7b-b155-776ce9574191,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:03.797905 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ae644f42-e978-4f48-88d9-e1c15806a1c0 admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:03.800005 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-ae644f42-e978-4f48-88d9-e1c15806a1c0 admin admin] 10.222.0.41 "DELETE /v2.0/subnets/5bd26c6d-2b2f-4a7b-b155-776ce9574191 HTTP/1.1" status: 204 len: 168 time: 0.2728608 Jun 17 11:12:03.806683 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ae644f42-e978-4f48-88d9-e1c15806a1c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:03.806788 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 42066) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:12:03.868669 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:03.946395 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:03.957244 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6fdf215c-4b9a-4c97-8019-724657b01fd2']}} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:12:03.967101 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1084bb90-956a-41ba-b787-bacf37c2838b') {'for_net_delete': True} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:12:03.967395 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1084bb90-956a-41ba-b787-bacf37c2838b') {} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:12:03.977491 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6228436'] for segment, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:03.991337 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:03.998352 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Releasing vlan 110 on physical network physnet1 to pool {{(pid=110214) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:12:03.998733 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6239464'] for segment, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: Traceback (most recent call last): Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: timer() Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: cb(*args, **kw) Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: return func(*args, **kwargs) Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: self._notify() Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: self.callback(batched_events) Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: event.method(event) Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: return f(self, *a, **k) Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._get(url).json() Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: return self.request(url, 'GET', **kwargs) Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:12:04.000341 dv-cinder-773870-6-iscsi neutron-server[110214]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:12:04.142147 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:04.147146 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:04.153562 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] 10.222.0.41 "DELETE /v2.0/networks/6fdf215c-4b9a-4c97-8019-724657b01fd2 HTTP/1.1" status: 204 len: 168 time: 0.3455296 Jun 17 11:12:04.153562 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:04.161827 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Pushing event deleted for resources: {'Network': ['ID=6fdf215c-4b9a-4c97-8019-724657b01fd2,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:04.169465 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.169846 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.170216 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.170579 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.170969 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.171329 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.171686 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.172073 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.172428 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.172929 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.173288 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.173639 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:04.176936 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9a162047-ceb9-4580-9bca-8782e6ddcd07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:04.504540 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42072) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:12:04.545118 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-702c1bea-8bf6-4759-b090-57a166b5b54e admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=2cebe420e11c4e19890964552961967d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0392523 Jun 17 11:12:04.547351 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42074) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:12:04.594551 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-327e2718-9340-4351-98e2-4fc643484e16 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:04.614789 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-327e2718-9340-4351-98e2-4fc643484e16 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:04.750401 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-327e2718-9340-4351-98e2-4fc643484e16 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:04.753034 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-327e2718-9340-4351-98e2-4fc643484e16 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:04.754171 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-327e2718-9340-4351-98e2-4fc643484e16 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/803c65cf-9f25-48a9-8169-d7775d8209a7 HTTP/1.1" status: 204 len: 168 time: 0.2059085 Jun 17 11:12:04.754979 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d6222b06-af69-44f5-ab35-79ce87830d07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:04.763384 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-327e2718-9340-4351-98e2-4fc643484e16 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=803c65cf-9f25-48a9-8169-d7775d8209a7,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:04.766885 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-327e2718-9340-4351-98e2-4fc643484e16 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:07.040703 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:12:07.721544 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:07.892305 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-ab872bc9-36bd-438f-9c86-f8c055596874 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/networks?tenant_id=4e64949b8385465c88eb650f73c03f4e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0333989 Jun 17 11:12:08.082280 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-d1c20f66-afe3-4bd5-8e81-a160588f8f71 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:08.083750 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-d1c20f66-afe3-4bd5-8e81-a160588f8f71 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1861188 Jun 17 11:12:08.099366 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-fcc5972c-7c6c-4266-9a79-605ca303e14d tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/quotas/4e64949b8385465c88eb650f73c03f4e HTTP/1.1" status: 200 len: 375 time: 0.0092108 Jun 17 11:12:08.131766 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-9a9353a0-7f32-4e95-bfc7-a3f18287aec6 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=4e64949b8385465c88eb650f73c03f4e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0264661 Jun 17 11:12:08.401438 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-bd56f774-ae37-434b-a9a5-7310fa3dcb33 req-572481f2-e89b-45b8-adb9-d1914fa14c14 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 210 time: 0.0391512 Jun 17 11:12:09.544615 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c1bfd87c-ffe5-4c3f-9480-17e0278d1492 req-3a81e0a3-13a8-4d7c-b071-724014304bbb tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 210 time: 0.0292127 Jun 17 11:12:10.691296 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-31110bea-8fa2-470c-ae89-e98608ba117e req-f613ae5d-eb93-4486-86e8-8aa0402f3fd1 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 210 time: 0.0296755 Jun 17 11:12:10.751909 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-582a0c9e-d826-45fa-a8e8-f3199c71b540 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.25 "GET /v2.0/networks?tenant_id=4e64949b8385465c88eb650f73c03f4e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0217550 Jun 17 11:12:10.861537 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-39a71c30-b441-4f49-8a76-e38b4d92b036 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:10.862980 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-39a71c30-b441-4f49-8a76-e38b4d92b036 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1057737 Jun 17 11:12:10.877412 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Request body: {'port': {'device_id': 'c8b68efe-921f-4890-bd7f-e4bfe2f62cf4', 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13', 'admin_state_up': True, 'tenant_id': '4e64949b8385465c88eb650f73c03f4e'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:12:11.052851 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Made reservation on behalf of 4e64949b8385465c88eb650f73c03f4e for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:12:11.057954 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:11.066463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:11.160006 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:11.225050 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:11.229003 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f1fe6949-19a9-4890-8547-29acbf3afa3c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:11.290713 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Pushing event updated for resources: {'SecurityGroup': ['ID=003553ec-ed32-43af-92a7-de8e7f87b79c,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:11.295274 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:11.373119 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Allocated IP 192.168.233.186 (f346e9b2-9fe2-4af1-8380-b232a75b9a13/bae7e2b1-4280-43ce-b1d4-41ed17f002e7/4a0c21f0-15da-4671-84e1-bc9f0782a707) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:12:11.518708 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:11.532542 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Transition to ACTIVE for port object 4a0c21f0-15da-4671-84e1-bc9f0782a707 will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:12:11.647875 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:11.651871 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:11.693727 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Network f346e9b2-9fe2-4af1-8380-b232a75b9a13 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:12:11.697501 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:12:11.701320 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:12:11.729375 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Pushing event updated for resources: {'Port': ['ID=4a0c21f0-15da-4671-84e1-bc9f0782a707,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:11.734019 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:11.763488 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:11.764253 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:11.842305 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.9685900 Jun 17 11:12:11.865531 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Request body: {'port': {'device_id': 'c8b68efe-921f-4890-bd7f-e4bfe2f62cf4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:12:11.942541 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:12.030268 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-bab4bfad-2acb-46d3-ae6f-cca0c6087df7 None None] Provisioning for port 4a0c21f0-15da-4671-84e1-bc9f0782a707 completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:12:12.034755 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-bab4bfad-2acb-46d3-ae6f-cca0c6087df7 None None] Provisioning complete for port 4a0c21f0-15da-4671-84e1-bc9f0782a707 triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:12:12.035311 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-bab4bfad-2acb-46d3-ae6f-cca0c6087df7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:12.074071 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-bab4bfad-2acb-46d3-ae6f-cca0c6087df7 None None] Port 4a0c21f0-15da-4671-84e1-bc9f0782a707 cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:12:12.137650 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d35b91cc-9382-4292-b657-ebabd1c11d93 req-7f71c18d-f8fb-43a5-87ca-df8e9fcbd257 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:12.139220 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d35b91cc-9382-4292-b657-ebabd1c11d93 req-7f71c18d-f8fb-43a5-87ca-df8e9fcbd257 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 936 time: 0.3288412 Jun 17 11:12:12.177031 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d35b91cc-9382-4292-b657-ebabd1c11d93 req-2d0f29f7-e81c-4bc8-b278-027824149b4c tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319881 Jun 17 11:12:12.228831 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4a0c21f0-15da-4671-84e1-bc9f0782a707 {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:12:12.236707 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:12.249119 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Transition to ACTIVE for port object 4a0c21f0-15da-4671-84e1-bc9f0782a707 will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:12:12.349877 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:12.352701 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3127aa0a-1270-42e1-94c9-1d822585fae4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:12.427528 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Pushing event updated for resources: {'Port': ['ID=4a0c21f0-15da-4671-84e1-bc9f0782a707,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:12.432030 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:12.502217 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Attempting to bind port 4a0c21f0-15da-4671-84e1-bc9f0782a707 on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:12:12.502554 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Attempting to bind port 4a0c21f0-15da-4671-84e1-bc9f0782a707 by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': 'c93a3072-686e-4699-8753-4cd5b8316f3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:12:12.502961 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Attempting to bind port 4a0c21f0-15da-4671-84e1-bc9f0782a707 on network f346e9b2-9fe2-4af1-8380-b232a75b9a13 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:12:12.507441 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Port 4a0c21f0-15da-4671-84e1-bc9f0782a707 on network f346e9b2-9fe2-4af1-8380-b232a75b9a13 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:12:12.508407 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Attempting to bind port 4a0c21f0-15da-4671-84e1-bc9f0782a707 on network f346e9b2-9fe2-4af1-8380-b232a75b9a13 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:12:12.513901 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 12, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:12:12.514239 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Checking segment: {'id': 'c93a3072-686e-4699-8753-4cd5b8316f3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:12:12.514629 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Bound using segment: {'id': 'c93a3072-686e-4699-8753-4cd5b8316f3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:12:12.515071 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Bound port: 4a0c21f0-15da-4671-84e1-bc9f0782a707, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c93a3072-686e-4699-8753-4cd5b8316f3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:12:12.515425 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:12.578613 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] For port 4a0c21f0-15da-4671-84e1-bc9f0782a707, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:12:12.581437 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] For port 4a0c21f0-15da-4671-84e1-bc9f0782a707, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=4a0c21f0-15da-4671-84e1-bc9f0782a707,segment=NetworkSegment(c93a3072-686e-4699-8753-4cd5b8316f3d),segment_id=c93a3072-686e-4699-8753-4cd5b8316f3d)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:12:12.649096 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:12.652077 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0819ebe6-e4db-43ed-b522-e9a8a25148bb tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:12.685366 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:12.686029 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:12.687471 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c4815732-a115-419e-b787-c2581ab47757 service neutron] 10.222.0.25 "PUT /v2.0/ports/4a0c21f0-15da-4671-84e1-bc9f0782a707 HTTP/1.1" status: 200 len: 1098 time: 0.8274255 Jun 17 11:12:12.687936 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c8b68efe-921f-4890-bd7f-e4bfe2f62cf4', 'tag': '4a0c21f0-15da-4671-84e1-bc9f0782a707'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:12:12.690218 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f5c8aa5f-e51d-48b5-9029-37e36ed44271" -d '{"events": [{"name": "network-changed", "server_uuid": "c8b68efe-921f-4890-bd7f-e4bfe2f62cf4", "tag": "4a0c21f0-15da-4671-84e1-bc9f0782a707"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:12:12.719694 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Pushing event updated for resources: {'Port': ['ID=4a0c21f0-15da-4671-84e1-bc9f0782a707,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:12.723102 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:12.741143 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:12:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-082b66a1-db9a-44ff-ac64-7cfdf3b6b9ad x-openstack-request-id: req-082b66a1-db9a-44ff-ac64-7cfdf3b6b9ad {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:12:12.741143 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c8b68efe-921f-4890-bd7f-e4bfe2f62cf4", "tag": "4a0c21f0-15da-4671-84e1-bc9f0782a707", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:12:12.741143 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-082b66a1-db9a-44ff-ac64-7cfdf3b6b9ad {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:12:12.741143 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c8b68efe-921f-4890-bd7f-e4bfe2f62cf4', 'tag': '4a0c21f0-15da-4671-84e1-bc9f0782a707', 'status': 'completed', 'code': 200} Jun 17 11:12:12.822590 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c8aa5f-e51d-48b5-9029-37e36ed44271 req-ebbbb755-b049-4134-add2-6cb3c9478baf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:12.824432 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f5c8aa5f-e51d-48b5-9029-37e36ed44271 req-ebbbb755-b049-4134-add2-6cb3c9478baf service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4e64949b8385465c88eb650f73c03f4e&device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 1101 time: 0.0597138 Jun 17 11:12:12.857232 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f5c8aa5f-e51d-48b5-9029-37e36ed44271 req-d9194857-a2e1-4ea7-be66-5f8dea8660d3 service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=4e64949b8385465c88eb650f73c03f4e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0200076 Jun 17 11:12:12.959608 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c8aa5f-e51d-48b5-9029-37e36ed44271 req-f4349ec1-5248-4f4b-b6ed-6d6060b3afab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:12.960957 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f5c8aa5f-e51d-48b5-9029-37e36ed44271 req-f4349ec1-5248-4f4b-b6ed-6d6060b3afab service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0913279 Jun 17 11:12:13.055663 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-49057014-89df-442f-88a8-a51beea87d44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:13.057240 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-49057014-89df-442f-88a8-a51beea87d44 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=4e64949b8385465c88eb650f73c03f4e&device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 1101 time: 0.0538208 Jun 17 11:12:13.099392 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-2b97e3d1-cfbe-4cb0-9a38-1cfda888827c service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.186&port_id=4a0c21f0-15da-4671-84e1-bc9f0782a707 HTTP/1.1" status: 200 len: 217 time: 0.0316317 Jun 17 11:12:13.149710 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-a385c739-0c1d-41a4-ab7c-41c6acf090d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:13.151145 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-a385c739-0c1d-41a4-ab7c-41c6acf090d3 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=bae7e2b1-4280-43ce-b1d4-41ed17f002e7 HTTP/1.1" status: 200 len: 843 time: 0.0429103 Jun 17 11:12:13.210172 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c0922c1a-5371-4e0f-badc-fa8c40d80192 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:13.212334 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-c0922c1a-5371-4e0f-badc-fa8c40d80192 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=f346e9b2-9fe2-4af1-8380-b232a75b9a13&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0540979 Jun 17 11:12:13.348575 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-59630c9d-8a68-4812-bf50-46f69c21a496 service neutron] 10.222.0.25 "GET /v2.0/networks/f346e9b2-9fe2-4af1-8380-b232a75b9a13?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1276357 Jun 17 11:12:13.390316 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f790bf1c-f790-4133-9ad6-308787d1b839 req-e7fe0137-6eb7-4c40-bbaa-e8927d6b56d4 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:13.391685 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f790bf1c-f790-4133-9ad6-308787d1b839 req-e7fe0137-6eb7-4c40-bbaa-e8927d6b56d4 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 948 time: 0.0990024 Jun 17 11:12:13.471959 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f790bf1c-f790-4133-9ad6-308787d1b839 req-703e560b-f2de-4fce-9905-8102fc5d8a33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735266 Jun 17 11:12:13.482895 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a7f408c8-e70b-47de-838c-3b5ef43c2e4b req-f48e3c6a-56d2-4c9f-aeb9-3e05e2797597 service neutron] 10.222.0.25 "GET /v2.0/networks/f346e9b2-9fe2-4af1-8380-b232a75b9a13?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1199474 Jun 17 11:12:14.644166 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19743112-cd3e-430c-983b-e9594b4fab92 req-7984d09b-28a5-433f-afe3-af7bd1abdab9 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:14.645721 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-19743112-cd3e-430c-983b-e9594b4fab92 req-7984d09b-28a5-433f-afe3-af7bd1abdab9 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 948 time: 0.0657060 Jun 17 11:12:14.684917 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-19743112-cd3e-430c-983b-e9594b4fab92 req-186a38da-8acb-4b4d-84a0-42b40d632f3b tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326657 Jun 17 11:12:15.857515 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b56c0387-99b3-47cb-9d24-8f62a10608d2 req-ee95337f-d879-4ac7-a514-048d917c1050 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:15.859035 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b56c0387-99b3-47cb-9d24-8f62a10608d2 req-ee95337f-d879-4ac7-a514-048d917c1050 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 948 time: 0.0666690 Jun 17 11:12:15.898290 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b56c0387-99b3-47cb-9d24-8f62a10608d2 req-01c68af1-d352-474a-ac74-d20826ffde02 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0337200 Jun 17 11:12:17.077531 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5706eeaf-2ccf-49b9-910a-bfcc98ef96bc req-26c4bc86-4a3b-4cfb-aa34-817c6d769ddf tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:17.079045 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5706eeaf-2ccf-49b9-910a-bfcc98ef96bc req-26c4bc86-4a3b-4cfb-aa34-817c6d769ddf tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 948 time: 0.0662405 Jun 17 11:12:17.120917 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-5706eeaf-2ccf-49b9-910a-bfcc98ef96bc req-7add4d94-496e-41be-a720-901b595bbde7 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362446 Jun 17 11:12:17.375235 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 4a0c21f0-15da-4671-84e1-bc9f0782a707 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:12:17.467374 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 4a0c21f0-15da-4671-84e1-bc9f0782a707, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=4a0c21f0-15da-4671-84e1-bc9f0782a707,segment=NetworkSegment(c93a3072-686e-4699-8753-4cd5b8316f3d),segment_id=c93a3072-686e-4699-8753-4cd5b8316f3d)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:12:17.477709 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '4a0c21f0-15da-4671-84e1-bc9f0782a707', 'network_id': 'f346e9b2-9fe2-4af1-8380-b232a75b9a13', 'port_id': '4a0c21f0-15da-4671-84e1-bc9f0782a707', 'mac_address': 'fa:16:3e:fc:2e:7d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 111, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bae7e2b1-4280-43ce-b1d4-41ed17f002e7', 'ip_address': '192.168.233.186'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:12:17.517042 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:17.529728 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4a0c21f0-15da-4671-84e1-bc9f0782a707 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:12:17.547786 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 4a0c21f0-15da-4671-84e1-bc9f0782a707, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=4a0c21f0-15da-4671-84e1-bc9f0782a707,segment=NetworkSegment(c93a3072-686e-4699-8753-4cd5b8316f3d),segment_id=c93a3072-686e-4699-8753-4cd5b8316f3d)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:12:17.661596 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:17.663328 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:17.710109 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=4a0c21f0-15da-4671-84e1-bc9f0782a707,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:17.717703 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.718047 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.718416 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.718754 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.719114 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.719445 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.719774 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.720097 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.720425 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.720748 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.721067 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.721443 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:17.725262 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:18.127534 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['4a0c21f0-15da-4671-84e1-bc9f0782a707'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:12:18.446964 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18ab569d-9631-4d27-a786-4c760b2d3677 req-b00fcd29-245e-48b8-9a42-255eb7a9ff13 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:18.448387 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-18ab569d-9631-4d27-a786-4c760b2d3677 req-b00fcd29-245e-48b8-9a42-255eb7a9ff13 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 949 time: 0.0625238 Jun 17 11:12:18.485294 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-18ab569d-9631-4d27-a786-4c760b2d3677 req-330750c7-74c2-483f-b366-1684590d1b34 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312576 Jun 17 11:12:19.371594 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 4a0c21f0-15da-4671-84e1-bc9f0782a707 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:12:19.521103 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 4a0c21f0-15da-4671-84e1-bc9f0782a707 completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:12:19.525353 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 4a0c21f0-15da-4671-84e1-bc9f0782a707 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:12:19.525740 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:19.604627 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:19.626983 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c8b68efe-921f-4890-bd7f-e4bfe2f62cf4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a0c21f0-15da-4671-84e1-bc9f0782a707'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:12:19.629240 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-83770dd3-047c-45d8-84a2-90e085db794c" -d '{"events": [{"server_uuid": "c8b68efe-921f-4890-bd7f-e4bfe2f62cf4", "name": "network-vif-plugged", "status": "completed", "tag": "4a0c21f0-15da-4671-84e1-bc9f0782a707"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:12:19.645861 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 4a0c21f0-15da-4671-84e1-bc9f0782a707, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=4a0c21f0-15da-4671-84e1-bc9f0782a707,segment=NetworkSegment(c93a3072-686e-4699-8753-4cd5b8316f3d),segment_id=c93a3072-686e-4699-8753-4cd5b8316f3d)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:12:19.662817 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d653c80b-2b79-4493-8726-e68c882fc6ae req-555a5c25-583f-4124-8748-93b205e78d64 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:19.664597 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d653c80b-2b79-4493-8726-e68c882fc6ae req-555a5c25-583f-4124-8748-93b205e78d64 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 949 time: 0.0652068 Jun 17 11:12:19.676165 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:12:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4671e55-6235-4311-9709-c2d0af82c159 x-openstack-request-id: req-e4671e55-6235-4311-9709-c2d0af82c159 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:12:19.676454 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c8b68efe-921f-4890-bd7f-e4bfe2f62cf4", "name": "network-vif-plugged", "status": "completed", "tag": "4a0c21f0-15da-4671-84e1-bc9f0782a707", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:12:19.676708 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-e4671e55-6235-4311-9709-c2d0af82c159 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:12:19.677105 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c8b68efe-921f-4890-bd7f-e4bfe2f62cf4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4a0c21f0-15da-4671-84e1-bc9f0782a707', 'code': 200} Jun 17 11:12:19.705571 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d653c80b-2b79-4493-8726-e68c882fc6ae req-de55acd6-183e-4db1-a11c-0ca195c2fefd tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339298 Jun 17 11:12:19.741381 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:19.743331 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:19.789877 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=4a0c21f0-15da-4671-84e1-bc9f0782a707,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:19.792695 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:20.040304 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35de3823-af93-46be-800a-540f2ee4e942 req-e4458a01-d608-42f7-bcd7-415a0c8cc735 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:20.042158 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-35de3823-af93-46be-800a-540f2ee4e942 req-e4458a01-d608-42f7-bcd7-415a0c8cc735 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 1103 time: 0.0540655 Jun 17 11:12:20.083978 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-35de3823-af93-46be-800a-540f2ee4e942 req-c36e03af-b4ff-4ea1-984f-5cac35dd98eb service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302315 Jun 17 11:12:20.695743 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-b9fd45f0-8200-4ca3-a357-b24726377cc3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:20.879307 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1320427b-1df4-4f1b-9d41-fc43af995bf2 req-3f16fb93-a3f4-4d8d-a06b-d3bb71f58e6d tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:20.880797 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1320427b-1df4-4f1b-9d41-fc43af995bf2 req-3f16fb93-a3f4-4d8d-a06b-d3bb71f58e6d tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 950 time: 0.0625238 Jun 17 11:12:20.922335 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1320427b-1df4-4f1b-9d41-fc43af995bf2 req-e389fd6f-87fb-4109-8b78-9eb9e0a6b5f6 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353909 Jun 17 11:12:22.100608 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502e7098-2872-4d55-9138-7f942e88b007 req-c2e7a289-8d32-406c-9e33-3a1272d6019a tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:22.102060 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-502e7098-2872-4d55-9138-7f942e88b007 req-c2e7a289-8d32-406c-9e33-3a1272d6019a tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 950 time: 0.0631750 Jun 17 11:12:22.140423 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-502e7098-2872-4d55-9138-7f942e88b007 req-148e9d36-d632-4171-bef3-cbec9747804e tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326622 Jun 17 11:12:22.795766 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef29adb8-aec0-4de9-af7c-6099f3969c8c req-2f002a24-2d1c-46c9-9fa4-46aa09e498a5 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:22.797106 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ef29adb8-aec0-4de9-af7c-6099f3969c8c req-2f002a24-2d1c-46c9-9fa4-46aa09e498a5 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 950 time: 0.0618248 Jun 17 11:12:22.838450 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ef29adb8-aec0-4de9-af7c-6099f3969c8c req-e7ba8aa6-93bd-43e8-8387-8de620f4e10e tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357718 Jun 17 11:12:23.375760 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-285c553b-72cc-42c5-903b-b14fad6870d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:23.619186 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:23.941404 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40093de0-3c8e-462f-a362-9cc8017692f2 req-05c16bd9-865a-43d3-9b30-79cd38b460f8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:23.942960 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-40093de0-3c8e-462f-a362-9cc8017692f2 req-05c16bd9-865a-43d3-9b30-79cd38b460f8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0634148 Jun 17 11:12:23.993380 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-40093de0-3c8e-462f-a362-9cc8017692f2 req-dea519fe-94f8-4dde-b151-bb26ec89ec36 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432611 Jun 17 11:12:24.025040 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-627a253e-30fb-4229-ace2-7d03476593c0 req-c506e69f-dc6a-48a3-90a8-e20f75cd62a0 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:24.027201 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-627a253e-30fb-4229-ace2-7d03476593c0 req-c506e69f-dc6a-48a3-90a8-e20f75cd62a0 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 950 time: 0.0718887 Jun 17 11:12:24.065610 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-627a253e-30fb-4229-ace2-7d03476593c0 req-ccf4bc39-01bc-4df1-8150-721f2cd30c66 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/security-groups?id=003553ec-ed32-43af-92a7-de8e7f87b79c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325954 Jun 17 11:12:24.453223 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c1c64b-9eb2-4731-af70-b0e160a33c4b req-ef20ef68-1cd4-47c7-803d-7edcd8c7375a tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:24.454642 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b6c1c64b-9eb2-4731-af70-b0e160a33c4b req-ef20ef68-1cd4-47c7-803d-7edcd8c7375a tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.25 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 950 time: 0.0615408 Jun 17 11:12:24.489787 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:24.554520 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-b6c1c64b-9eb2-4731-af70-b0e160a33c4b req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Deleting port 4a0c21f0-15da-4671-84e1-bc9f0782a707 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:12:24.554790 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b6c1c64b-9eb2-4731-af70-b0e160a33c4b req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:24.641858 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-b6c1c64b-9eb2-4731-af70-b0e160a33c4b req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] For port 4a0c21f0-15da-4671-84e1-bc9f0782a707, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=4a0c21f0-15da-4671-84e1-bc9f0782a707,segment=NetworkSegment(c93a3072-686e-4699-8753-4cd5b8316f3d),segment_id=c93a3072-686e-4699-8753-4cd5b8316f3d)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:12:24.642214 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b6c1c64b-9eb2-4731-af70-b0e160a33c4b req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:24.706623 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-b6c1c64b-9eb2-4731-af70-b0e160a33c4b req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Calling delete_port for 4a0c21f0-15da-4671-84e1-bc9f0782a707 owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:12:25.153256 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b6c1c64b-9eb2-4731-af70-b0e160a33c4b req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:25.157992 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-49aee28d-8cdd-45e5-b526-fcf8266fdf89 tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:25.166742 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['4a0c21f0-15da-4671-84e1-bc9f0782a707'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:12:25.188225 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Pushing event deleted for resources: {'Port': ['ID=4a0c21f0-15da-4671-84e1-bc9f0782a707,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:25.210790 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ea67d3-5f2e-4248-94c1-36f07395e4e8 req-5071b336-e8c7-4ab7-b98b-ad49c82cc909 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:25.215341 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-57ea67d3-5f2e-4248-94c1-36f07395e4e8 req-5071b336-e8c7-4ab7-b98b-ad49c82cc909 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.1058576 Jun 17 11:12:25.217293 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.217672 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.217796 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6527a5ea-305a-4694-a184-d437b825e507 req-688ada6d-3904-48d9-b8cc-faae03b5d9c6 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 210 time: 0.0295329 Jun 17 11:12:25.218229 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.218485 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.218903 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.219285 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.219643 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.219996 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.220958 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.221416 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.221768 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.222374 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:12:25.227054 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:25.288599 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6c1c64b-9eb2-4731-af70-b0e160a33c4b req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] No DVR routers for this DVR port 4a0c21f0-15da-4671-84e1-bc9f0782a707 on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:12:25.288599 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-b6c1c64b-9eb2-4731-af70-b0e160a33c4b req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:25.288917 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b6c1c64b-9eb2-4731-af70-b0e160a33c4b req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.25 "DELETE /v2.0/ports/4a0c21f0-15da-4671-84e1-bc9f0782a707 HTTP/1.1" status: 204 len: 173 time: 0.8285806 Jun 17 11:12:25.289857 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c8b68efe-921f-4890-bd7f-e4bfe2f62cf4', 'name': 'network-vif-deleted', 'tag': '4a0c21f0-15da-4671-84e1-bc9f0782a707'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:12:25.293200 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66bc264d-d9e9-4c89-8728-e006db0aaf29" -d '{"events": [{"server_uuid": "c8b68efe-921f-4890-bd7f-e4bfe2f62cf4", "name": "network-vif-deleted", "tag": "4a0c21f0-15da-4671-84e1-bc9f0782a707"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:12:25.323002 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-57ea67d3-5f2e-4248-94c1-36f07395e4e8 req-8a64826c-ebfe-4383-b3a4-790cd026fa2d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0945864 Jun 17 11:12:25.345208 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:12:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11e187e1-b3a4-4777-bde9-2f656847aab5 x-openstack-request-id: req-11e187e1-b3a4-4777-bde9-2f656847aab5 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:12:25.345704 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c8b68efe-921f-4890-bd7f-e4bfe2f62cf4", "name": "network-vif-deleted", "tag": "4a0c21f0-15da-4671-84e1-bc9f0782a707", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:12:25.345858 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-11e187e1-b3a4-4777-bde9-2f656847aab5 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:12:25.346278 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c8b68efe-921f-4890-bd7f-e4bfe2f62cf4', 'name': 'network-vif-deleted', 'tag': '4a0c21f0-15da-4671-84e1-bc9f0782a707', 'status': 'completed', 'code': 200} Jun 17 11:12:26.376563 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-287711f6-9665-404d-bfb4-c44d8788780a req-f9f61437-8bf4-4645-900b-c6c9f31f3bc3 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] 10.222.0.41 "GET /v2.0/ports?device_id=c8b68efe-921f-4890-bd7f-e4bfe2f62cf4 HTTP/1.1" status: 200 len: 210 time: 0.0297956 Jun 17 11:12:26.496459 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1ca95c-126d-44d8-a217-88815be2d7f4 req-11e8855e-be51-4ee8-954c-a6fd9136d356 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:26.497819 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7f1ca95c-126d-44d8-a217-88815be2d7f4 req-11e8855e-be51-4ee8-954c-a6fd9136d356 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0620775 Jun 17 11:12:26.534515 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7f1ca95c-126d-44d8-a217-88815be2d7f4 req-ebbc6640-3799-41e5-bb13-8123b1c7bd88 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309138 Jun 17 11:12:26.872882 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:27.412945 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 4a0c21f0-15da-4671-84e1-bc9f0782a707 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:12:27.433487 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 4a0c21f0-15da-4671-84e1-bc9f0782a707 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:12:27.433844 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 4a0c21f0-15da-4671-84e1-bc9f0782a707 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:12:27.718000 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4fd79cc-802a-4649-857f-bbc9f59acf34 req-a59a5496-294a-40b0-8362-3cb7a3377eb8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:27.719503 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d4fd79cc-802a-4649-857f-bbc9f59acf34 req-a59a5496-294a-40b0-8362-3cb7a3377eb8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0669794 Jun 17 11:12:27.756862 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-d4fd79cc-802a-4649-857f-bbc9f59acf34 req-0c1f4109-4b6a-4d64-9ebf-af9e7b9c04ad tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0316496 Jun 17 11:12:28.939528 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7ecaea-a9e8-4336-ac67-0ca12523347b req-ab955311-76b0-4606-ad6e-3d5b50b16cc7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:28.940939 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4d7ecaea-a9e8-4336-ac67-0ca12523347b req-ab955311-76b0-4606-ad6e-3d5b50b16cc7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0656905 Jun 17 11:12:28.996398 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4d7ecaea-a9e8-4336-ac67-0ca12523347b req-ced98ccd-9ce6-4498-b81b-17172664ddc9 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496011 Jun 17 11:12:30.178120 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7ce42ab-af7f-4fa5-a59d-1a1dc8be7331 req-38a14781-9330-4c34-8b34-c3c33176cf17 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:30.180562 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c7ce42ab-af7f-4fa5-a59d-1a1dc8be7331 req-38a14781-9330-4c34-8b34-c3c33176cf17 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0671132 Jun 17 11:12:30.219103 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c7ce42ab-af7f-4fa5-a59d-1a1dc8be7331 req-4c067511-620d-47a2-aab3-77daa19bc9c6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0320754 Jun 17 11:12:31.397692 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-894c50c2-8712-4d35-8e88-0a9352cb1874 req-150c1ea9-63f6-48b2-84c1-2187c875fe98 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:31.399299 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-894c50c2-8712-4d35-8e88-0a9352cb1874 req-150c1ea9-63f6-48b2-84c1-2187c875fe98 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0635090 Jun 17 11:12:31.437026 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-894c50c2-8712-4d35-8e88-0a9352cb1874 req-ddfd6420-3324-4a60-978a-7933df3f3a7f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0315726 Jun 17 11:12:32.617328 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b821048e-6a0a-4912-b2a7-1d190ed39305 req-266c3418-6b2a-4afb-98c3-2a0260a6b213 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:32.618837 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b821048e-6a0a-4912-b2a7-1d190ed39305 req-266c3418-6b2a-4afb-98c3-2a0260a6b213 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0629251 Jun 17 11:12:32.659451 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b821048e-6a0a-4912-b2a7-1d190ed39305 req-01b75ed3-0754-41aa-9efb-d6b33fc88d00 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0348473 Jun 17 11:12:33.478143 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42470) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:12:33.626648 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-2e1ce2e7-eac5-4227-b22c-bd95068e5a74 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=4e64949b8385465c88eb650f73c03f4e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1469998 Jun 17 11:12:33.629034 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42474) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:12:33.682414 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9de2a567-ebf2-4e8f-95f7-f44b9069f11f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:33.703468 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9de2a567-ebf2-4e8f-95f7-f44b9069f11f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:33.835548 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-585b7ddd-8897-4cec-a3fc-24c3e5a35dc3 req-b05eb53f-e3d9-40a2-a826-a0bb462bd15b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:33.836963 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-585b7ddd-8897-4cec-a3fc-24c3e5a35dc3 req-b05eb53f-e3d9-40a2-a826-a0bb462bd15b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0619266 Jun 17 11:12:33.874272 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-585b7ddd-8897-4cec-a3fc-24c3e5a35dc3 req-2cdff2b3-ccf0-4315-88de-6eb76b6384cc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0314763 Jun 17 11:12:33.884004 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9de2a567-ebf2-4e8f-95f7-f44b9069f11f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:33.887067 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9de2a567-ebf2-4e8f-95f7-f44b9069f11f admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:33.888126 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-9de2a567-ebf2-4e8f-95f7-f44b9069f11f admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/003553ec-ed32-43af-92a7-de8e7f87b79c HTTP/1.1" status: 204 len: 168 time: 0.2581797 Jun 17 11:12:33.888984 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d6987cbf-9113-4b08-a42c-04aa57f9668e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:33.898820 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9de2a567-ebf2-4e8f-95f7-f44b9069f11f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=003553ec-ed32-43af-92a7-de8e7f87b79c,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:33.900429 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9de2a567-ebf2-4e8f-95f7-f44b9069f11f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:35.064723 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66eec7b2-dfce-4be7-91ad-e0ad0dbd9373 req-99cf7944-a531-4222-a03f-85a362c17936 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:35.066144 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-66eec7b2-dfce-4be7-91ad-e0ad0dbd9373 req-99cf7944-a531-4222-a03f-85a362c17936 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0764282 Jun 17 11:12:35.103505 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-66eec7b2-dfce-4be7-91ad-e0ad0dbd9373 req-ac91b088-c6b5-49ed-8dbb-b83d751c7245 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0311527 Jun 17 11:12:36.279867 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276d4e60-a7f5-40b7-bfd0-85c43a950908 req-3074f430-1ba5-430f-a175-a6105756eeb5 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:36.281327 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-276d4e60-a7f5-40b7-bfd0-85c43a950908 req-3074f430-1ba5-430f-a175-a6105756eeb5 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0626888 Jun 17 11:12:36.318704 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-276d4e60-a7f5-40b7-bfd0-85c43a950908 req-53eb75e8-61b3-4645-bc68-be3dc8c30e40 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0318286 Jun 17 11:12:37.495440 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70ce70f1-3cec-4ee0-bb3a-1a03bd4f417a req-87075da1-a7ae-4443-9460-dbbd143772d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:37.496906 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-70ce70f1-3cec-4ee0-bb3a-1a03bd4f417a req-87075da1-a7ae-4443-9460-dbbd143772d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0652628 Jun 17 11:12:37.533426 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-70ce70f1-3cec-4ee0-bb3a-1a03bd4f417a req-741154ae-4854-4368-b12a-76d6dfd14424 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0308580 Jun 17 11:12:37.767396 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:38.714630 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641cdd13-6857-41d7-843a-11cbfe54fe24 req-983eed4c-4512-42d5-bcd5-8c1d391858d2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:38.716099 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-641cdd13-6857-41d7-843a-11cbfe54fe24 req-983eed4c-4512-42d5-bcd5-8c1d391858d2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0684109 Jun 17 11:12:38.752641 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-641cdd13-6857-41d7-843a-11cbfe54fe24 req-e9ddeb9b-3697-4128-a454-8ba112bf4602 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309706 Jun 17 11:12:39.931906 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b250956b-75af-428e-b72f-87083bb3978d req-a21411e9-7977-4116-8302-40cf59f180ed tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:39.933335 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b250956b-75af-428e-b72f-87083bb3978d req-a21411e9-7977-4116-8302-40cf59f180ed tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0647774 Jun 17 11:12:39.970112 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b250956b-75af-428e-b72f-87083bb3978d req-5e0e46d5-5df8-4175-ad95-3bb8130da131 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310678 Jun 17 11:12:41.153717 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e113f6e7-389a-4b44-867c-c8413300f0da req-6eb3a395-4b85-4e2f-b672-d310cedfa07d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:41.155175 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e113f6e7-389a-4b44-867c-c8413300f0da req-6eb3a395-4b85-4e2f-b672-d310cedfa07d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0615525 Jun 17 11:12:41.192094 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e113f6e7-389a-4b44-867c-c8413300f0da req-ff69b13d-3666-41df-ba33-27a3c00a2f07 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0314064 Jun 17 11:12:41.528527 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device bb8e800d-0d92-4757-af24-da32b3db8d82 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:12:41.621266 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:12:41.631901 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'port_id': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'mac_address': 'fa:16:3e:b3:98:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:12:41.667995 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:41.680375 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id bb8e800d-0d92-4757-af24-da32b3db8d82 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:12:41.700540 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:12:41.769403 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:41.771289 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-bfa1ec4a-0bc2-4e7b-a360-e4cd2942fc1d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:41.822944 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=bb8e800d-0d92-4757-af24-da32b3db8d82,revision_number=6']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:41.825755 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:41.858836 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['bb8e800d-0d92-4757-af24-da32b3db8d82'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:12:42.367937 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dea1b58-41d6-4193-ace0-5b7a6ade118d req-dee48b70-1b4a-4185-bd19-a87832bc5170 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:42.369968 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4dea1b58-41d6-4193-ace0-5b7a6ade118d req-dee48b70-1b4a-4185-bd19-a87832bc5170 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 944 time: 0.0616407 Jun 17 11:12:42.405901 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4dea1b58-41d6-4193-ace0-5b7a6ade118d req-09354e43-8817-4e66-a671-a97de24d226e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0304067 Jun 17 11:12:42.827676 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba28d332-85a3-4680-8644-330c07e8ad3b req-49c2d9b5-f0db-42f9-a24d-0398314eb022 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:42.829178 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba28d332-85a3-4680-8644-330c07e8ad3b req-49c2d9b5-f0db-42f9-a24d-0398314eb022 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 1097 time: 0.0569315 Jun 17 11:12:42.929991 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba28d332-85a3-4680-8644-330c07e8ad3b req-486bb9d2-0755-4b2e-b52d-134cffb7d88e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:42.931689 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba28d332-85a3-4680-8644-330c07e8ad3b req-486bb9d2-0755-4b2e-b52d-134cffb7d88e service neutron] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 918 time: 0.0827000 Jun 17 11:12:42.997870 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba28d332-85a3-4680-8644-330c07e8ad3b req-51d4b913-34a7-4ebb-9c88-ce14ebf9cbc3 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=bb8e800d-0d92-4757-af24-da32b3db8d82 HTTP/1.1" status: 200 len: 1000 time: 0.0591464 Jun 17 11:12:43.046122 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba28d332-85a3-4680-8644-330c07e8ad3b req-e15c3044-8c13-4d90-92de-f412e7fa4ea8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:43.047528 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba28d332-85a3-4680-8644-330c07e8ad3b req-e15c3044-8c13-4d90-92de-f412e7fa4ea8 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0424960 Jun 17 11:12:43.104877 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba28d332-85a3-4680-8644-330c07e8ad3b req-17b86981-3195-4a15-bce6-c2f386087d4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:43.106296 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba28d332-85a3-4680-8644-330c07e8ad3b req-17b86981-3195-4a15-bce6-c2f386087d4e service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0517774 Jun 17 11:12:43.197813 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba28d332-85a3-4680-8644-330c07e8ad3b req-a7dd1899-691a-4951-8aad-c7bd4dd237a2 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831416 Jun 17 11:12:43.285659 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba28d332-85a3-4680-8644-330c07e8ad3b req-4e07edb3-5b14-4ee0-8109-236c0a8c9246 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0807683 Jun 17 11:12:43.545458 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device bb8e800d-0d92-4757-af24-da32b3db8d82 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:12:43.587207 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e449217d-d875-479e-828f-9bc4367df23e req-b0882593-ec93-4a33-aee3-8fbcd127dc9d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:43.588721 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e449217d-d875-479e-828f-9bc4367df23e req-b0882593-ec93-4a33-aee3-8fbcd127dc9d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 944 time: 0.0675142 Jun 17 11:12:43.595159 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port bb8e800d-0d92-4757-af24-da32b3db8d82 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:12:43.595547 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:43.627691 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e449217d-d875-479e-828f-9bc4367df23e req-b3786a7d-a66e-4aa5-b227-22daa3f9510e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0333326 Jun 17 11:12:43.671731 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:43.695250 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:12:43.702095 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3295c7c6-ef29-467f-bf1d-068d484384ff" -d '{"events": [{"server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "name": "network-vif-plugged", "status": "completed", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:12:43.709965 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:12:43.734662 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:12:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-97e348ce-d274-4c0f-a87c-fdf2d20be0fd x-openstack-request-id: req-97e348ce-d274-4c0f-a87c-fdf2d20be0fd {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:12:43.735005 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "name": "network-vif-plugged", "status": "completed", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:12:43.735264 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-97e348ce-d274-4c0f-a87c-fdf2d20be0fd {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:12:43.735661 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'code': 200} Jun 17 11:12:43.778118 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:43.780042 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-88f57125-5ad0-4a64-a816-845c2aa09674 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:12:43.825639 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=bb8e800d-0d92-4757-af24-da32b3db8d82,revision_number=7']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:12:43.828685 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:12:44.040006 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:12:44.804463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e3100e-0bdf-4638-a489-93b9fb892905 req-94406379-b2fc-44bc-8b04-8e8754bdb939 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:44.806434 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f1e3100e-0bdf-4638-a489-93b9fb892905 req-94406379-b2fc-44bc-8b04-8e8754bdb939 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0654845 Jun 17 11:12:44.842824 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-f1e3100e-0bdf-4638-a489-93b9fb892905 req-db721e52-b6dc-419b-a94f-6937afdeca52 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0308509 Jun 17 11:12:46.022532 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa4c024-a6ec-43f9-bee4-e628f136f4be req-cec5ec73-e89c-4d6b-974d-2647d65367b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:46.024029 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-faa4c024-a6ec-43f9-bee4-e628f136f4be req-cec5ec73-e89c-4d6b-974d-2647d65367b7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0639405 Jun 17 11:12:46.066251 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-faa4c024-a6ec-43f9-bee4-e628f136f4be req-c9d06a5f-e4f3-4dca-b1a4-7c50405eb09a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0360315 Jun 17 11:12:47.314632 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524f9839-8cc6-4199-b15a-3fbd8faabc5f req-3ab48662-c441-46ab-bc7d-28743f80d096 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:47.316414 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-524f9839-8cc6-4199-b15a-3fbd8faabc5f req-3ab48662-c441-46ab-bc7d-28743f80d096 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.1118646 Jun 17 11:12:47.371383 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-524f9839-8cc6-4199-b15a-3fbd8faabc5f req-f7f00288-0cec-4288-b4d2-032dc0553e70 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476730 Jun 17 11:12:48.567749 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42c3b757-81dd-4c1b-8b02-4c9de2bbe368 req-fb50355b-a921-4aef-be1a-4ca4f82730dc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:48.569203 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-42c3b757-81dd-4c1b-8b02-4c9de2bbe368 req-fb50355b-a921-4aef-be1a-4ca4f82730dc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0708780 Jun 17 11:12:48.625312 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-42c3b757-81dd-4c1b-8b02-4c9de2bbe368 req-f2bc4319-e31e-4a3f-9c75-64c7549d6129 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488505 Jun 17 11:12:49.839808 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ee64d82-8d92-4420-b78a-afff0bd83bc8 req-70e51315-4d8c-4646-83ef-96d29b29f356 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:49.842261 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6ee64d82-8d92-4420-b78a-afff0bd83bc8 req-70e51315-4d8c-4646-83ef-96d29b29f356 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0747986 Jun 17 11:12:49.887766 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-6ee64d82-8d92-4420-b78a-afff0bd83bc8 req-47ab3af5-ba24-4e96-81da-dae711921fbd tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398326 Jun 17 11:12:50.655483 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f64f86ef-4802-49cc-85f3-93078a1a2d83 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:51.075866 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44394bc-3e97-4a80-8b18-b1e7b38f8391 req-756e640f-a249-46a5-8fad-0e97d4ffd647 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:51.081825 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b44394bc-3e97-4a80-8b18-b1e7b38f8391 req-756e640f-a249-46a5-8fad-0e97d4ffd647 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0709698 Jun 17 11:12:51.117613 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b44394bc-3e97-4a80-8b18-b1e7b38f8391 req-da7923cd-af76-4a22-b205-c228555f1ba1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0342343 Jun 17 11:12:52.316361 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e87d5490-112b-41cd-99e9-af296b2038c7 req-6ab73365-a528-4119-b374-dcb32253a4ed tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:52.317857 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e87d5490-112b-41cd-99e9-af296b2038c7 req-6ab73365-a528-4119-b374-dcb32253a4ed tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0655177 Jun 17 11:12:52.356143 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-e87d5490-112b-41cd-99e9-af296b2038c7 req-20a33e92-8721-4551-9852-8461a95d7642 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313296 Jun 17 11:12:53.354937 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-74f77ff1-04f9-437d-ad75-4858e20779d6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:53.576497 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3e94ab0-a1d5-48eb-81d7-7edd1e31135e req-fdb84f9a-8a4a-4454-a413-fb482f36754c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:53.578890 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c3e94ab0-a1d5-48eb-81d7-7edd1e31135e req-fdb84f9a-8a4a-4454-a413-fb482f36754c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0995412 Jun 17 11:12:53.584144 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:53.623796 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-c3e94ab0-a1d5-48eb-81d7-7edd1e31135e req-d64874e8-caa7-4b98-a186-c6cbd3eb3603 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0348799 Jun 17 11:12:54.500776 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:54.846415 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-094b6c16-dd97-4108-bbf8-86017846ff8e req-3bcf7a07-f453-419b-9aae-acad87c6bd86 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:54.847971 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-094b6c16-dd97-4108-bbf8-86017846ff8e req-3bcf7a07-f453-419b-9aae-acad87c6bd86 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0822856 Jun 17 11:12:54.891467 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-094b6c16-dd97-4108-bbf8-86017846ff8e req-a0c25eb1-aefb-49ee-9609-b29567b2d0d1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0377073 Jun 17 11:12:56.081864 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b268b20c-4ed5-4f33-9251-75426264a6fe req-15eca156-44c5-4775-a727-6347422e508a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:56.083544 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b268b20c-4ed5-4f33-9251-75426264a6fe req-15eca156-44c5-4775-a727-6347422e508a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0683997 Jun 17 11:12:56.127097 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-b268b20c-4ed5-4f33-9251-75426264a6fe req-e424c6e7-308f-484e-bd21-ce4b40c60e39 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0370190 Jun 17 11:12:56.821310 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:12:57.306264 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9bb8f15-ce9d-4beb-a961-52d495c2bdfc req-b90f3714-5395-4a2d-9464-383fe0a28c4c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:57.307740 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d9bb8f15-ce9d-4beb-a961-52d495c2bdfc req-b90f3714-5395-4a2d-9464-383fe0a28c4c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0639093 Jun 17 11:12:57.344020 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d9bb8f15-ce9d-4beb-a961-52d495c2bdfc req-1bfa5f76-0202-4857-84f3-cf06b5d06694 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306756 Jun 17 11:12:57.552170 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed67b21-4a1c-4d4e-8994-4593fb1f09ed req-5d81723a-941a-47ec-8ae7-e4e91c6ae946 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:57.553557 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ed67b21-4a1c-4d4e-8994-4593fb1f09ed req-5d81723a-941a-47ec-8ae7-e4e91c6ae946 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 1098 time: 0.0531867 Jun 17 11:12:57.647956 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed67b21-4a1c-4d4e-8994-4593fb1f09ed req-9ec0be78-f5d0-4342-ad9e-35101fef098d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:57.649412 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ed67b21-4a1c-4d4e-8994-4593fb1f09ed req-9ec0be78-f5d0-4342-ad9e-35101fef098d service neutron] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 918 time: 0.0878847 Jun 17 11:12:57.716848 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ed67b21-4a1c-4d4e-8994-4593fb1f09ed req-388e2e99-59d6-4766-8c62-3df8e0f128b3 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=bb8e800d-0d92-4757-af24-da32b3db8d82 HTTP/1.1" status: 200 len: 1001 time: 0.0574217 Jun 17 11:12:57.768898 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed67b21-4a1c-4d4e-8994-4593fb1f09ed req-1d0fd65c-e9be-497c-9a3a-3dd03c996416 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:57.770338 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ed67b21-4a1c-4d4e-8994-4593fb1f09ed req-1d0fd65c-e9be-497c-9a3a-3dd03c996416 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0469084 Jun 17 11:12:57.827841 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed67b21-4a1c-4d4e-8994-4593fb1f09ed req-6c4543a3-4ed0-496b-99b6-0b7d2862fa83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:57.829240 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ed67b21-4a1c-4d4e-8994-4593fb1f09ed req-6c4543a3-4ed0-496b-99b6-0b7d2862fa83 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0516543 Jun 17 11:12:57.923780 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ed67b21-4a1c-4d4e-8994-4593fb1f09ed req-eb2a6b98-a098-4bd4-9608-fb005c81e60f service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874057 Jun 17 11:12:58.021118 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4ed67b21-4a1c-4d4e-8994-4593fb1f09ed req-f75440b5-b0ea-4b74-8594-04999f9ac422 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904982 Jun 17 11:12:58.518612 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd6fe81-1e00-4e70-920e-06c0321d614f req-a4c69128-d5b6-441e-add4-cf8afe4883ee tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:58.520236 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5dd6fe81-1e00-4e70-920e-06c0321d614f req-a4c69128-d5b6-441e-add4-cf8afe4883ee tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0625806 Jun 17 11:12:58.561909 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5dd6fe81-1e00-4e70-920e-06c0321d614f req-333a12fe-0504-4b94-a03d-4e8f8679dc79 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0360024 Jun 17 11:12:59.738863 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315ce958-76e7-4ad7-8520-58e0db0b187b req-4b6ea092-630b-454c-b556-9f158df674cf tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:12:59.740337 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-315ce958-76e7-4ad7-8520-58e0db0b187b req-4b6ea092-630b-454c-b556-9f158df674cf tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 945 time: 0.0652628 Jun 17 11:12:59.784679 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-315ce958-76e7-4ad7-8520-58e0db0b187b req-d34e0f3f-1237-4150-a2f1-89b4388a9086 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0382218 Jun 17 11:13:00.578375 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device bb8e800d-0d92-4757-af24-da32b3db8d82 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:13:00.653373 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:00.675502 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:13:00.677756 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25466a13-2d39-4e11-9bfe-9e9d5182565c" -d '{"events": [{"server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "name": "network-vif-unplugged", "status": "completed", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:13:00.690738 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:13:00.715166 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 17 Jun 2021 11:13:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81ee69db-7a0e-4257-8a56-c7458c8baef4 x-openstack-request-id: req-81ee69db-7a0e-4257-8a56-c7458c8baef4 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:13:00.715468 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "name": "network-vif-unplugged", "status": "completed", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:13:00.715731 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-81ee69db-7a0e-4257-8a56-c7458c8baef4 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:13:00.716133 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'code': 200} Jun 17 11:13:00.763839 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:00.766933 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:13:00.825399 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=bb8e800d-0d92-4757-af24-da32b3db8d82,revision_number=8']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:13:00.829649 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:13:00.967199 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fab57c-5217-415a-b38f-fa5afcb11871 req-dfe62748-bc3e-476b-9946-f537be730814 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:00.968664 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b9fab57c-5217-415a-b38f-fa5afcb11871 req-dfe62748-bc3e-476b-9946-f537be730814 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0625405 Jun 17 11:13:01.007418 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-b9fab57c-5217-415a-b38f-fa5afcb11871 req-4b4b2106-339c-48eb-91dd-fcdb80d0afb7 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0332017 Jun 17 11:13:02.225906 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f37af9a-a3ab-402c-9e90-16dc9953680a req-0bdf9656-fd3a-4ace-a48c-14a2c46a047e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:02.227559 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5f37af9a-a3ab-402c-9e90-16dc9953680a req-0bdf9656-fd3a-4ace-a48c-14a2c46a047e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0641103 Jun 17 11:13:02.266080 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-5f37af9a-a3ab-402c-9e90-16dc9953680a req-ca9626f7-d5a8-4c24-a85a-783acd9d34db tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0328467 Jun 17 11:13:03.462112 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c74a9328-5f73-4598-8edb-c76421f1468e req-3a06f797-0aed-4c39-ab9b-dbac245e72f6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:03.463829 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c74a9328-5f73-4598-8edb-c76421f1468e req-3a06f797-0aed-4c39-ab9b-dbac245e72f6 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0775948 Jun 17 11:13:03.506627 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c74a9328-5f73-4598-8edb-c76421f1468e req-7887a54d-284e-42ba-be9e-1551e0921062 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0368612 Jun 17 11:13:04.687212 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd45924-3215-444a-9ec6-ae9c2ed2013b req-aeb204bd-d7e0-4d6f-8eff-0e48f9adc845 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:04.688764 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4dd45924-3215-444a-9ec6-ae9c2ed2013b req-aeb204bd-d7e0-4d6f-8eff-0e48f9adc845 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0658901 Jun 17 11:13:04.734336 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4dd45924-3215-444a-9ec6-ae9c2ed2013b req-e18180f1-115a-4f61-bdcb-e92258adc135 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0325768 Jun 17 11:13:05.664987 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device bb8e800d-0d92-4757-af24-da32b3db8d82 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:13:07.315935 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba787bbe-409e-42f2-abcd-3cc197c80eee req-70db165b-84b3-4569-bc5c-1bf7ae6b683b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:07.317420 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ba787bbe-409e-42f2-abcd-3cc197c80eee req-70db165b-84b3-4569-bc5c-1bf7ae6b683b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0673368 Jun 17 11:13:07.354734 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ba787bbe-409e-42f2-abcd-3cc197c80eee req-b638f3dc-18f6-43fe-8e08-6fa1bedf8f69 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0316436 Jun 17 11:13:07.808170 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-86f09ff7-df23-4262-95f7-c6311523470d service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1580307 Jun 17 11:13:07.877475 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:08.545610 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bba5896e-fc24-4c69-843f-43419e988d87 req-724db4e7-5c14-4f6e-aabc-b3884c54b189 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:08.547012 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bba5896e-fc24-4c69-843f-43419e988d87 req-724db4e7-5c14-4f6e-aabc-b3884c54b189 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0689707 Jun 17 11:13:08.588169 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bba5896e-fc24-4c69-843f-43419e988d87 req-bc939e6c-5c09-4368-8ce5-544c9b8ea458 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0353827 Jun 17 11:13:09.476483 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-1b76eda5-e8a7-468c-89b6-f98724489ddc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:09.480483 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-1b76eda5-e8a7-468c-89b6-f98724489ddc service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1&tenant_id=e96eb64d17bd425d9b0a15bc07c55136 HTTP/1.1" status: 200 len: 1096 time: 0.0733290 Jun 17 11:13:09.560739 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-ff75c11d-a383-4edd-bcff-dae0558f411a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:09.562233 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-ff75c11d-a383-4edd-bcff-dae0558f411a service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 1096 time: 0.0568414 Jun 17 11:13:09.659943 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-27bc9913-d2dd-4639-8c4c-c093ad6481ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:09.661408 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-27bc9913-d2dd-4639-8c4c-c093ad6481ae service neutron] 10.222.0.25 "GET /v2.0/networks?id=68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 200 len: 918 time: 0.0922430 Jun 17 11:13:09.746631 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-77e3d13e-8856-4987-990a-8d8b416fd45e service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=bb8e800d-0d92-4757-af24-da32b3db8d82 HTTP/1.1" status: 200 len: 999 time: 0.0634012 Jun 17 11:13:09.775682 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-779df08a-163b-451f-8aeb-b5ad43597f04 req-b2571e82-5257-4080-bd4d-88b54dd55844 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:09.777251 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-779df08a-163b-451f-8aeb-b5ad43597f04 req-b2571e82-5257-4080-bd4d-88b54dd55844 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0661159 Jun 17 11:13:09.783611 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-9c613288-48ac-4951-bf02-59d818688d98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:09.785230 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-9c613288-48ac-4951-bf02-59d818688d98 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 200 len: 856 time: 0.0474792 Jun 17 11:13:09.821067 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-779df08a-163b-451f-8aeb-b5ad43597f04 req-c9498fba-3726-4e8d-931d-4345c1bf1750 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0374627 Jun 17 11:13:09.847020 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-2ec68227-a1ff-45be-b9c9-a1d59ac5d6c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:09.848480 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-2ec68227-a1ff-45be-b9c9-a1d59ac5d6c2 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=68556f75-deee-4c64-96a7-37433fd16432&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0562675 Jun 17 11:13:09.944681 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-18652acd-918d-4853-9cb5-6d23eb94117e service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891063 Jun 17 11:13:10.057900 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-12f44888-4848-4fe7-ad10-f97d05c184af tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1961343052&fields=id&tenant_id=a7706f138ac3465ba5820edf148d8153 HTTP/1.1" status: 200 len: 267 time: 0.0528276 Jun 17 11:13:10.059759 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-bde42c6f-be6b-484b-8cce-3cf3197556a4 req-3ce77080-50c5-44b1-81ab-a34b7c4965e2 service neutron] 10.222.0.25 "GET /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1089218 Jun 17 11:13:10.159632 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-1d9be459-0e51-4e8b-a69f-4014859fcaf4 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:10.161044 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-1d9be459-0e51-4e8b-a69f-4014859fcaf4 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 812 time: 0.0967689 Jun 17 11:13:10.175544 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-72bc8fb9-2bd3-4472-a918-23a5b7120f62 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/quotas/a7706f138ac3465ba5820edf148d8153 HTTP/1.1" status: 200 len: 375 time: 0.0090210 Jun 17 11:13:10.251572 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-5ce4a678-5615-4f4d-a18b-8ec6a315f4b4 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0702517 Jun 17 11:13:10.352407 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-4181ca5e-945b-4d13-b7b5-fe2285a58385 service neutron] 10.222.0.41 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886366 Jun 17 11:13:10.450991 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-4ff0461f-0b39-4885-8c61-0adb55648190 service neutron] 10.222.0.41 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0920608 Jun 17 11:13:11.058443 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a652aa9-f802-4ab8-a8da-e1b807433978 req-2c06b1a7-ca21-490a-ba85-103116d942d4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:11.060286 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3a652aa9-f802-4ab8-a8da-e1b807433978 req-2c06b1a7-ca21-490a-ba85-103116d942d4 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0987809 Jun 17 11:13:11.104890 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-db2f0556-9a5b-4004-94cc-54f76c90249e req-68d75dad-a026-4e19-8ab6-fadf49ac928d tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0403044 Jun 17 11:13:11.140991 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3a652aa9-f802-4ab8-a8da-e1b807433978 req-7663e2ff-a27c-4c10-bf62-78e007ac3aed tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0731363 Jun 17 11:13:12.265872 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7b7afa58-e9d4-4b28-af2d-58a1c4794838 req-c36d2a45-dd6d-42eb-a908-704ad099f115 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0397298 Jun 17 11:13:12.353025 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed5b8b3-db45-4c32-b605-cfe9a8c0edb3 req-5c92b5c7-87f5-4f71-ae0b-ed8bdfe4e001 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:12.354598 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0ed5b8b3-db45-4c32-b605-cfe9a8c0edb3 req-5c92b5c7-87f5-4f71-ae0b-ed8bdfe4e001 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0666091 Jun 17 11:13:12.403168 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0ed5b8b3-db45-4c32-b605-cfe9a8c0edb3 req-da0b739b-4214-4b46-8828-f3cad5ae0549 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418191 Jun 17 11:13:13.408405 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7a686adc-788c-480c-a0c0-c2dc6fc025a3 req-9452020b-ad9c-4044-b9e3-af879b283d65 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0278556 Jun 17 11:13:13.586461 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a7fff1-b4fb-4c7b-9bed-939896484df1 req-bb6ca74f-ec7e-45e4-8a5e-dd0504e3f21f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:13.588030 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-88a7fff1-b4fb-4c7b-9bed-939896484df1 req-bb6ca74f-ec7e-45e4-8a5e-dd0504e3f21f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0655510 Jun 17 11:13:13.626865 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-88a7fff1-b4fb-4c7b-9bed-939896484df1 req-42b75ec0-8ca6-4a50-80e7-181369f2fb2c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0330741 Jun 17 11:13:14.553807 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a13d698c-8d5a-4327-828f-9971fa96b46a req-1bb08c89-1978-4b3d-b279-bc117521dd27 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0329041 Jun 17 11:13:14.814612 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-449d71a0-d2c8-411a-aa25-927d50abb6b6 req-acd10de2-280e-4aaa-b813-0c19c781da22 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:14.816042 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-449d71a0-d2c8-411a-aa25-927d50abb6b6 req-acd10de2-280e-4aaa-b813-0c19c781da22 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0691812 Jun 17 11:13:14.855729 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-449d71a0-d2c8-411a-aa25-927d50abb6b6 req-6ddd1ea1-1b67-4c3b-854c-96ad04b2180e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0327117 Jun 17 11:13:15.701670 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd981fc8-bd74-4011-9144-6a4e8c273f53 req-6f6604d5-1b36-4e7b-85a5-1e2e7107ea53 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0288079 Jun 17 11:13:16.037779 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617726a9-542a-4ceb-b87d-1249aff9cee0 req-85dc2f6e-f02c-426d-83e3-f230ded543cc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:16.039469 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-617726a9-542a-4ceb-b87d-1249aff9cee0 req-85dc2f6e-f02c-426d-83e3-f230ded543cc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0639095 Jun 17 11:13:16.078711 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-617726a9-542a-4ceb-b87d-1249aff9cee0 req-a25bb753-4171-4b08-bd0e-a22aa06a0c69 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0333669 Jun 17 11:13:16.842957 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8dc1bf9d-3e2c-4fc2-841e-195d6b3572f7 req-e79011f2-22a8-45c7-bbb0-f89bfa278320 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0289834 Jun 17 11:13:17.280404 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc90c54b-8078-475e-9476-d019422c59a5 req-45eca336-dfc1-4fc8-bf40-c5f7f3edcd5b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:17.282477 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fc90c54b-8078-475e-9476-d019422c59a5 req-45eca336-dfc1-4fc8-bf40-c5f7f3edcd5b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0846195 Jun 17 11:13:17.329097 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fc90c54b-8078-475e-9476-d019422c59a5 req-c2d47e64-5a52-4b50-ba13-10ee460f9163 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390344 Jun 17 11:13:18.009855 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4b4b550a-de36-45ee-b9f2-1ceda5abf810 req-5dfff0ee-5ee5-4f52-863d-3108ace18091 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0348234 Jun 17 11:13:18.517062 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5f73e07-f76c-477b-b1db-e1de67c4c11c req-c29547e5-b3ca-4235-afe0-4b3b38da0455 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:18.518519 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f5f73e07-f76c-477b-b1db-e1de67c4c11c req-c29547e5-b3ca-4235-afe0-4b3b38da0455 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0683253 Jun 17 11:13:18.557721 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f5f73e07-f76c-477b-b1db-e1de67c4c11c req-48c8e59e-19f6-42b5-abea-13e6818ace3c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0335546 Jun 17 11:13:19.155377 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-37d9bb4b-6440-4bd4-b284-53c61f55a321 req-148600c2-c19f-49fa-a01c-525666a30f45 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0335336 Jun 17 11:13:19.751648 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e6c3da-49ef-447b-ba13-65e81a880bbd req-f3642c42-0c66-4cdc-98ec-92a6dfa91f9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:19.753115 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e7e6c3da-49ef-447b-ba13-65e81a880bbd req-f3642c42-0c66-4cdc-98ec-92a6dfa91f9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0650227 Jun 17 11:13:19.792087 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e7e6c3da-49ef-447b-ba13-65e81a880bbd req-7f8bdfc3-0919-413f-907f-6e6c1b6c3406 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0325265 Jun 17 11:13:20.296462 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-dc424f17-f222-497d-9198-eb19506e820c req-86342cd5-142f-46c2-8892-36ab71ae6ef2 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0298874 Jun 17 11:13:20.631149 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a3aba3ed-b397-47a7-bc96-17f68a0ad9a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:20.969566 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a14e19-334a-4bd7-92e5-7a406ae16239 req-efe724f5-958b-42fa-a694-b14ec72359f8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:20.971012 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-26a14e19-334a-4bd7-92e5-7a406ae16239 req-efe724f5-958b-42fa-a694-b14ec72359f8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0635562 Jun 17 11:13:21.006603 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-26a14e19-334a-4bd7-92e5-7a406ae16239 req-09957798-62d4-4775-a7ae-8a78efc324f0 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0300169 Jun 17 11:13:21.038274 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:13:21.431859 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-2d9e4e31-a457-48ac-9dd1-206e09ebc04c req-4b49e725-0c9b-4520-8f78-4c735c09ee48 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0276246 Jun 17 11:13:22.178764 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-539bf885-ea74-466e-a3bb-64ccb81cc04a req-4590efd5-8198-4a91-86bf-848867d4054f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:22.180319 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-539bf885-ea74-466e-a3bb-64ccb81cc04a req-4590efd5-8198-4a91-86bf-848867d4054f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0611334 Jun 17 11:13:22.216429 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-539bf885-ea74-466e-a3bb-64ccb81cc04a req-5efbb3c9-1a5a-4ca3-a504-c33862ad856e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0307672 Jun 17 11:13:22.571564 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd71a26b-f5c7-44a7-95e2-d188681b65f7 req-66a9b709-9bd6-43b0-8a94-347c28055ba9 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0268734 Jun 17 11:13:23.345372 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f49b4daa-1108-4847-a233-0285c6a0ae0a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:23.389174 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42b2da2-6131-413f-bab0-4455448b5f65 req-7545b2cb-5458-4c25-83b9-d117e7e90e2b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:23.390657 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a42b2da2-6131-413f-bab0-4455448b5f65 req-7545b2cb-5458-4c25-83b9-d117e7e90e2b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0621200 Jun 17 11:13:23.432357 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-a42b2da2-6131-413f-bab0-4455448b5f65 req-5ddeeeb4-7d64-44f5-8788-7df4836ff71e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0358808 Jun 17 11:13:23.631268 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:23.711908 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-da4f094b-e6e4-4b72-b08a-822db9740cac req-9acb3406-9ef1-41cb-9583-7b69672bba91 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0301092 Jun 17 11:13:24.641004 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f63e5124-7c91-4fb6-8fff-34c31924a72f req-f982c858-0b02-4bc0-a630-7954932cd594 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:24.642666 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f63e5124-7c91-4fb6-8fff-34c31924a72f req-f982c858-0b02-4bc0-a630-7954932cd594 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0762134 Jun 17 11:13:24.682011 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f63e5124-7c91-4fb6-8fff-34c31924a72f req-50ceb596-579e-48da-97b4-9908d5720539 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0336614 Jun 17 11:13:24.853697 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-0639778a-3ddf-4563-ae5d-ada4073f5e5b req-a71d238a-9e3d-4435-9757-6c784792430c tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0278919 Jun 17 11:13:25.155059 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:25.858976 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41aeeac4-cf30-4430-ba01-76548ad2e192 req-a29769de-fe06-44bf-b2f2-69a36e93470c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:25.860461 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-41aeeac4-cf30-4430-ba01-76548ad2e192 req-a29769de-fe06-44bf-b2f2-69a36e93470c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0635295 Jun 17 11:13:25.900662 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-41aeeac4-cf30-4430-ba01-76548ad2e192 req-dfa1b0cd-e1c2-4681-b9c4-c7055e436e34 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0346425 Jun 17 11:13:25.915007 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-00aa7aee-db87-4344-b61b-4ccf2816cf38 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:25.916455 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-00aa7aee-db87-4344-b61b-4ccf2816cf38 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 812 time: 0.1056650 Jun 17 11:13:25.992067 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-2f2afae9-aa91-4081-bd5b-6a6a92d8fa1b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a7706f138ac3465ba5820edf148d8153 HTTP/1.1" status: 200 len: 380 time: 0.0553124 Jun 17 11:13:26.011643 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d4ecc876-66d6-4fb2-ba25-4ccd8b4d81a4 req-33c4cf98-f3a9-48e4-8e49-d2c040c675c9 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0391793 Jun 17 11:13:26.014798 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'port': {'device_id': '375d3e67-d829-4a23-be0d-2ba418784148', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'admin_state_up': True, 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'security_groups': ['3b3dcbc2-41c2-439d-a885-9ba22ead5a7e']}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:13:26.200431 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Made reservation on behalf of a7706f138ac3465ba5820edf148d8153 for: {'port': 1} {{(pid=110215) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Jun 17 11:13:26.204606 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:26.344072 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Allocated IP 172.20.0.4 (79f5bf09-f965-46d9-8615-13aab136e8eb/1df800fd-de2b-4d27-b603-4af981229332/770bcd1d-11b2-4b20-b754-72ef4900bdad) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:13:26.492851 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:26.506795 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Transition to ACTIVE for port object 770bcd1d-11b2-4b20-b754-72ef4900bdad will not be triggered until provisioned by entity DHCP. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:13:26.597806 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:26.602576 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:13:26.642003 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Network 79f5bf09-f965-46d9-8615-13aab136e8eb is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:13:26.645560 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:13:26.652350 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:13:26.677467 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'Port': ['ID=770bcd1d-11b2-4b20-b754-72ef4900bdad,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:13:26.694617 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.694617 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.694617 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.694617 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.694617 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.694617 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.694617 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.695362 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.695362 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.695533 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.695840 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.696193 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:26.701763 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:13:26.718665 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:26.723146 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:26.798069 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7901049 Jun 17 11:13:26.809662 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Request body: {'port': {'device_id': '375d3e67-d829-4a23-be0d-2ba418784148', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77387'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:13:26.821094 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:26.887620 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:26.956606 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2d87d8e1-3bfd-42f5-8a3b-e2ebd44374a8 None None] Provisioning for port 770bcd1d-11b2-4b20-b754-72ef4900bdad completed by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:13:26.960748 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-2d87d8e1-3bfd-42f5-8a3b-e2ebd44374a8 None None] Provisioning complete for port 770bcd1d-11b2-4b20-b754-72ef4900bdad triggered by entity DHCP. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:13:26.964800 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2d87d8e1-3bfd-42f5-8a3b-e2ebd44374a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:26.998631 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2d87d8e1-3bfd-42f5-8a3b-e2ebd44374a8 None None] Port 770bcd1d-11b2-4b20-b754-72ef4900bdad cannot update to ACTIVE because it is not bound. {{(pid=110216) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Jun 17 11:13:27.104514 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d4fa9c0-5fe1-4017-bdb4-85b7d08380f0 req-292b386e-7486-4c22-8e51-680b96020dee tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:27.106023 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3d4fa9c0-5fe1-4017-bdb4-85b7d08380f0 req-292b386e-7486-4c22-8e51-680b96020dee tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 943 time: 0.0870700 Jun 17 11:13:27.146661 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-3d4fa9c0-5fe1-4017-bdb4-85b7d08380f0 req-dd445f00-cbf0-4752-9458-eb02ff9c15df tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0343814 Jun 17 11:13:27.473458 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 770bcd1d-11b2-4b20-b754-72ef4900bdad {{(pid=110215) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:13:27.482197 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:27.498481 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.provisioning_blocks [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Transition to ACTIVE for port object 770bcd1d-11b2-4b20-b754-72ef4900bdad will not be triggered until provisioned by entity L2. {{(pid=110215) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Jun 17 11:13:27.517791 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ebcdd7-f758-40a3-901f-f3ce67408ab8 req-33bcd76b-639c-4f70-8a3b-3c520e94f86e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:27.519254 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79ebcdd7-f758-40a3-901f-f3ce67408ab8 req-33bcd76b-639c-4f70-8a3b-3c520e94f86e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 931 time: 0.3676510 Jun 17 11:13:27.554980 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-79ebcdd7-f758-40a3-901f-f3ce67408ab8 req-ea73c939-98c7-456f-a4c5-0ba7304e6f6d tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0300467 Jun 17 11:13:27.600047 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:27.603046 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-aab6484f-d6fa-467c-a57d-b6a2be82366f tempest-VolumesActionsTest-1285588072 tempest-VolumesActionsTest-1285588072-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:13:27.676744 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Pushing event updated for resources: {'Port': ['ID=770bcd1d-11b2-4b20-b754-72ef4900bdad,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:13:27.693760 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:13:27.734091 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device bb8e800d-0d92-4757-af24-da32b3db8d82 details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:13:27.746810 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Attempting to bind port 770bcd1d-11b2-4b20-b754-72ef4900bdad on host hv-cinder-77387 for vnic_type normal with profile {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Jun 17 11:13:27.747181 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Attempting to bind port 770bcd1d-11b2-4b20-b754-72ef4900bdad by drivers openvswitch,hyperv on host hv-cinder-77387 at level 0 using segments [{'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Jun 17 11:13:27.747660 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Attempting to bind port 770bcd1d-11b2-4b20-b754-72ef4900bdad on network 79f5bf09-f965-46d9-8615-13aab136e8eb {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:13:27.752120 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Port 770bcd1d-11b2-4b20-b754-72ef4900bdad on network 79f5bf09-f965-46d9-8615-13aab136e8eb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77387 {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} Jun 17 11:13:27.752448 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Attempting to bind port 770bcd1d-11b2-4b20-b754-72ef4900bdad on network 79f5bf09-f965-46d9-8615-13aab136e8eb {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} Jun 17 11:13:27.757485 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Checking agent: {'id': 'a45541f3-6d3e-4429-9a38-50fcb0aacd56', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77387', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'started_at': datetime.datetime(2021, 6, 17, 10, 57, 34), 'heartbeat_timestamp': datetime.datetime(2021, 6, 17, 11, 13, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} Jun 17 11:13:27.758333 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Checking segment: {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=110215) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} Jun 17 11:13:27.758702 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Bound using segment: {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'} {{(pid=110215) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} Jun 17 11:13:27.759152 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.managers [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Bound port: 770bcd1d-11b2-4b20-b754-72ef4900bdad, host: hv-cinder-77387, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4b17136b-e614-458c-90d5-3642ab6ac536', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb'}}] {{(pid=110215) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Jun 17 11:13:27.759501 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.822314 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:13:27.825422 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:13:27.829756 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] For port 770bcd1d-11b2-4b20-b754-72ef4900bdad, host hv-cinder-77387, cleared binding levels {{(pid=110215) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} Jun 17 11:13:27.832814 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] For port 770bcd1d-11b2-4b20-b754-72ef4900bdad, host hv-cinder-77387, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=770bcd1d-11b2-4b20-b754-72ef4900bdad,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110215) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} Jun 17 11:13:27.843871 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:13:27.852412 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'port_id': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'mac_address': 'fa:16:3e:b3:98:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:13:27.891448 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:27.904127 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bb8e800d-0d92-4757-af24-da32b3db8d82 {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:13:27.905876 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:27.908904 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9cea23d0-6031-4e82-8e92-afa87558cffa tempest-AttachVolumeTestJSON-402324629 tempest-AttachVolumeTestJSON-402324629-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:13:27.922733 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:13:27.939988 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:27.940599 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:27.941939 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] 10.222.0.25 "PUT /v2.0/ports/770bcd1d-11b2-4b20-b754-72ef4900bdad HTTP/1.1" status: 200 len: 1093 time: 1.1366088 Jun 17 11:13:27.942453 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '375d3e67-d829-4a23-be0d-2ba418784148', 'tag': '770bcd1d-11b2-4b20-b754-72ef4900bdad'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:13:27.944740 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3945648a-2336-464d-9575-fe334e726622" -d '{"events": [{"name": "network-changed", "server_uuid": "375d3e67-d829-4a23-be0d-2ba418784148", "tag": "770bcd1d-11b2-4b20-b754-72ef4900bdad"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:13:27.970760 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Pushing event updated for resources: {'Port': ['ID=770bcd1d-11b2-4b20-b754-72ef4900bdad,revision_number=3']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:13:27.973402 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:13:27.985899 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:13:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7b08d0b-b6e1-4d85-b4f5-55a468059903 x-openstack-request-id: req-b7b08d0b-b6e1-4d85-b4f5-55a468059903 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:13:27.986196 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "375d3e67-d829-4a23-be0d-2ba418784148", "tag": "770bcd1d-11b2-4b20-b754-72ef4900bdad", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:13:27.986492 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-b7b08d0b-b6e1-4d85-b4f5-55a468059903 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:13:27.986954 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '375d3e67-d829-4a23-be0d-2ba418784148', 'tag': '770bcd1d-11b2-4b20-b754-72ef4900bdad', 'status': 'completed', 'code': 200} Jun 17 11:13:28.014297 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:28.016144 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:13:28.065362 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=bb8e800d-0d92-4757-af24-da32b3db8d82,revision_number=9']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:13:28.072658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3945648a-2336-464d-9575-fe334e726622 req-d28f2e1f-744f-4921-8ab8-587822a55676 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:28.073209 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.073567 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.073914 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.074124 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3945648a-2336-464d-9575-fe334e726622 req-d28f2e1f-744f-4921-8ab8-587822a55676 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 1096 time: 0.0663619 Jun 17 11:13:28.074240 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.074578 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.074942 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.075274 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.075604 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.075938 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.076265 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.076590 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.076916 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:13:28.080847 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:13:28.172116 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3945648a-2336-464d-9575-fe334e726622 req-34ee1dc3-b6aa-4724-9f6a-ce29f6b0205a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:28.174035 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3945648a-2336-464d-9575-fe334e726622 req-34ee1dc3-b6aa-4724-9f6a-ce29f6b0205a service neutron] 10.222.0.25 "GET /v2.0/networks?tenant_id=a7706f138ac3465ba5820edf148d8153&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0906584 Jun 17 11:13:28.295283 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3945648a-2336-464d-9575-fe334e726622 req-3cd9d168-69d9-4ae1-bc96-b987cdeb7b10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:28.296569 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3945648a-2336-464d-9575-fe334e726622 req-3cd9d168-69d9-4ae1-bc96-b987cdeb7b10 service neutron] 10.222.0.25 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1166465 Jun 17 11:13:28.330310 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf1fc4b4-0626-462e-83f8-78b6f2032350 req-c41f7670-34c3-4043-bb09-606b2df52eda tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:28.331786 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cf1fc4b4-0626-462e-83f8-78b6f2032350 req-c41f7670-34c3-4043-bb09-606b2df52eda tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 944 time: 0.0697980 Jun 17 11:13:28.369427 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['bb8e800d-0d92-4757-af24-da32b3db8d82'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:13:28.400590 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cf1fc4b4-0626-462e-83f8-78b6f2032350 req-2390041b-a0ab-4f5a-8b6f-85fd69d001fc tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0580752 Jun 17 11:13:28.415249 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-b1f58a67-d59b-418d-8dd9-c60a34ab1e4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:28.416712 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-b1f58a67-d59b-418d-8dd9-c60a34ab1e4c service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 1096 time: 0.0813837 Jun 17 11:13:28.476295 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-23bf2e65-f35c-4ed0-8631-732a0eabd980 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=770bcd1d-11b2-4b20-b754-72ef4900bdad HTTP/1.1" status: 200 len: 217 time: 0.0327125 Jun 17 11:13:28.523306 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-13eee180-f028-4bd8-b4be-6aefac48e1f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:28.524721 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-13eee180-f028-4bd8-b4be-6aefac48e1f7 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0416193 Jun 17 11:13:28.585748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-8d8371db-06e7-48c7-9f38-e34b06151ac4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:28.587259 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-8d8371db-06e7-48c7-9f38-e34b06151ac4 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0544987 Jun 17 11:13:28.682137 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-41ea524b-ce1e-4b46-88b6-e12395e61141 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866044 Jun 17 11:13:28.733914 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16527859-18e3-4c3c-b278-6f45e96b7b2c req-991c28b4-5424-4100-a28d-478d78a44b08 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:28.735465 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-16527859-18e3-4c3c-b278-6f45e96b7b2c req-991c28b4-5424-4100-a28d-478d78a44b08 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 943 time: 0.0657823 Jun 17 11:13:28.773059 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-16527859-18e3-4c3c-b278-6f45e96b7b2c req-0fa23eaf-3cb1-40f5-afd3-46419b829757 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316148 Jun 17 11:13:28.775918 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9e50cfa8-a757-4322-9d7f-697fa66674a3 req-6eb5b5d3-4ac9-4a3e-b24f-3aabd8f09ad2 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860150 Jun 17 11:13:29.572162 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cb92a88-b7b8-4ea6-8fe9-45e6c01c1c99 req-bf5696c9-7aa1-495d-9832-2b9800873e7c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:29.573582 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7cb92a88-b7b8-4ea6-8fe9-45e6c01c1c99 req-bf5696c9-7aa1-495d-9832-2b9800873e7c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 944 time: 0.0606234 Jun 17 11:13:29.610485 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-7cb92a88-b7b8-4ea6-8fe9-45e6c01c1c99 req-311b8d5d-7b22-4e18-9f04-a0889e606dc1 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313523 Jun 17 11:13:29.736036 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device bb8e800d-0d92-4757-af24-da32b3db8d82 up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:13:29.782385 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port bb8e800d-0d92-4757-af24-da32b3db8d82 triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:13:29.782766 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:29.856824 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:29.881451 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:13:29.883758 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36311b5b-c476-41bc-90ff-e78dfa6ab69b" -d '{"events": [{"server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "name": "network-vif-plugged", "status": "completed", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:13:29.897950 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:13:29.919058 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:13:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d892b2cb-ddc6-4a8c-b1fc-cd47c9d639ec x-openstack-request-id: req-d892b2cb-ddc6-4a8c-b1fc-cd47c9d639ec {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:13:29.919364 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "name": "network-vif-plugged", "status": "completed", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:13:29.919627 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-d892b2cb-ddc6-4a8c-b1fc-cd47c9d639ec {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:13:29.920029 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'code': 200} Jun 17 11:13:29.952654 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f324e75b-2016-48f5-8058-b0881d2b6b5d req-8a30678d-01c6-435e-899a-92a4749b89d0 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:29.954183 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f324e75b-2016-48f5-8058-b0881d2b6b5d req-8a30678d-01c6-435e-899a-92a4749b89d0 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 943 time: 0.0709829 Jun 17 11:13:29.997858 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f324e75b-2016-48f5-8058-b0881d2b6b5d req-691f3fe5-dc2f-4fbb-ba9c-5106fb7e9f69 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375786 Jun 17 11:13:30.045539 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:30.047757 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-c7a8b39d-bc51-43f6-8689-ffc104bce60e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:13:30.093790 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=bb8e800d-0d92-4757-af24-da32b3db8d82,revision_number=10']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:13:30.097312 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:13:30.296073 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de9b685a-a4d0-4a82-8758-64e38eaa5e8e req-435880f3-88f7-496a-81d4-db76d4844b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:30.297441 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-de9b685a-a4d0-4a82-8758-64e38eaa5e8e req-435880f3-88f7-496a-81d4-db76d4844b4a service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 1099 time: 0.0502915 Jun 17 11:13:30.332103 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-de9b685a-a4d0-4a82-8758-64e38eaa5e8e req-f67d890e-84c1-4abd-b01f-74460f5b1ce1 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0276439 Jun 17 11:13:30.797284 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c5bf4f-4930-428c-8dca-cdeba5eb4e87 req-83b62738-bdb3-497b-8c2f-ff7c83a3abd0 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:30.798769 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c7c5bf4f-4930-428c-8dca-cdeba5eb4e87 req-83b62738-bdb3-497b-8c2f-ff7c83a3abd0 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 946 time: 0.0652757 Jun 17 11:13:30.835154 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c7c5bf4f-4930-428c-8dca-cdeba5eb4e87 req-f3b9d516-e192-49b4-9b27-c7b1c0f90dda tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306816 Jun 17 11:13:31.176537 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fe6344a-cd9c-46f5-ae61-02f7e27d2030 req-a0fd29ab-63af-4e0e-8887-be52d3d835d1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:31.177982 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7fe6344a-cd9c-46f5-ae61-02f7e27d2030 req-a0fd29ab-63af-4e0e-8887-be52d3d835d1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 943 time: 0.0619466 Jun 17 11:13:31.220008 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-7fe6344a-cd9c-46f5-ae61-02f7e27d2030 req-a6df22b6-beb7-4890-972d-68c54eaa7aa0 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0363555 Jun 17 11:13:32.013344 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c73bb71-9d0f-4456-9165-582aaa509cb0 req-760c905a-c507-4491-9f58-7ca1b56ebc2f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:32.014708 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1c73bb71-9d0f-4456-9165-582aaa509cb0 req-760c905a-c507-4491-9f58-7ca1b56ebc2f tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 946 time: 0.0629904 Jun 17 11:13:32.050323 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1c73bb71-9d0f-4456-9165-582aaa509cb0 req-8053f5e0-df04-4baa-baaf-fb3d273bd67e tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0300710 Jun 17 11:13:32.394516 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1821cbaa-b11f-414c-b63f-f30c992128f3 req-c987c080-46b2-42f6-a546-66962be791c4 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:32.396983 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1821cbaa-b11f-414c-b63f-f30c992128f3 req-c987c080-46b2-42f6-a546-66962be791c4 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 943 time: 0.0682828 Jun 17 11:13:32.440825 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-1821cbaa-b11f-414c-b63f-f30c992128f3 req-8d0a8f71-1db4-4d85-bf51-868a77d58a46 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0337238 Jun 17 11:13:33.224356 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1786a8b3-20b0-4d87-b169-64a8d703f2f9 req-c349b71d-44ff-41d1-b015-89b14e763ad2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:33.225779 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1786a8b3-20b0-4d87-b169-64a8d703f2f9 req-c349b71d-44ff-41d1-b015-89b14e763ad2 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 946 time: 0.0609248 Jun 17 11:13:33.267880 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1786a8b3-20b0-4d87-b169-64a8d703f2f9 req-5fa505e3-2c9d-4f39-a5e0-a89e23c3437b tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0358183 Jun 17 11:13:33.614102 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bfca90b-07e9-46c8-827f-c4ed771beed1 req-80672e32-b028-4db2-bc46-9abca535ddb5 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:33.615562 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6bfca90b-07e9-46c8-827f-c4ed771beed1 req-80672e32-b028-4db2-bc46-9abca535ddb5 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 943 time: 0.0646038 Jun 17 11:13:33.652279 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-6bfca90b-07e9-46c8-827f-c4ed771beed1 req-a180da5d-5b04-48de-ae2d-bee5b69a41fb tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304382 Jun 17 11:13:34.822388 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1183959-f5eb-4979-b3b6-5c1d09294da2 req-5c665e0b-8525-4d5c-90d2-0017a223e89b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:34.823867 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c1183959-f5eb-4979-b3b6-5c1d09294da2 req-5c665e0b-8525-4d5c-90d2-0017a223e89b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 943 time: 0.0623250 Jun 17 11:13:34.859968 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c1183959-f5eb-4979-b3b6-5c1d09294da2 req-0eeeab24-af49-4dd7-a628-4f76216f0fce tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0301459 Jun 17 11:13:36.026140 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb8a04c9-0a5b-4be6-90b8-7f62f29eef2b req-6090135c-01f0-40bb-90fe-761d37b72daa tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:36.027488 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fb8a04c9-0a5b-4be6-90b8-7f62f29eef2b req-6090135c-01f0-40bb-90fe-761d37b72daa tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 943 time: 0.0607746 Jun 17 11:13:36.062854 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-fb8a04c9-0a5b-4be6-90b8-7f62f29eef2b req-764cda89-1ebf-4c63-bbe3-650fc73cdc99 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0299385 Jun 17 11:13:37.232751 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716838db-ee15-427e-84d0-9fb93feaad9d req-0b765b98-74a6-4806-80ce-9613305573db tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:37.234192 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-716838db-ee15-427e-84d0-9fb93feaad9d req-0b765b98-74a6-4806-80ce-9613305573db tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 943 time: 0.0620580 Jun 17 11:13:37.271907 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-716838db-ee15-427e-84d0-9fb93feaad9d req-068cdb42-d596-439d-8048-f122b242f707 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320289 Jun 17 11:13:37.762476 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 770bcd1d-11b2-4b20-b754-72ef4900bdad details requested by agent hyperv_hv-cinder-77387 with host hv-cinder-77387 {{(pid=110216) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Jun 17 11:13:37.830447 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:37.857939 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 770bcd1d-11b2-4b20-b754-72ef4900bdad, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=770bcd1d-11b2-4b20-b754-72ef4900bdad,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:13:37.867907 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Returning: {'device': '770bcd1d-11b2-4b20-b754-72ef4900bdad', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'port_id': '770bcd1d-11b2-4b20-b754-72ef4900bdad', 'mac_address': 'fa:16:3e:1e:84:18', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 135, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=110216) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Jun 17 11:13:38.022167 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:38.034143 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 770bcd1d-11b2-4b20-b754-72ef4900bdad {{(pid=110216) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Jun 17 11:13:38.053529 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 770bcd1d-11b2-4b20-b754-72ef4900bdad, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=770bcd1d-11b2-4b20-b754-72ef4900bdad,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:13:38.137618 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:38.140478 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:13:38.187277 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=770bcd1d-11b2-4b20-b754-72ef4900bdad,revision_number=4']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:13:38.190471 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:13:38.444427 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8045dc30-9195-4f70-aa19-3d25fd4060d5 req-899680f3-61ad-4204-a894-db073d2e6e44 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:38.446107 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8045dc30-9195-4f70-aa19-3d25fd4060d5 req-899680f3-61ad-4204-a894-db073d2e6e44 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 944 time: 0.0640969 Jun 17 11:13:38.489750 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-8045dc30-9195-4f70-aa19-3d25fd4060d5 req-406f94a4-ca0c-424c-895f-33a2b47fe221 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374789 Jun 17 11:13:38.522572 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] get_ports_and_sgs() called for port_ids ['770bcd1d-11b2-4b20-b754-72ef4900bdad'] {{(pid=110216) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} Jun 17 11:13:39.679590 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a17fa487-3c59-42e6-a0dc-de1386dcc492 req-da8394a2-4543-44c7-a60f-e2a70f392284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:39.681649 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a17fa487-3c59-42e6-a0dc-de1386dcc492 req-da8394a2-4543-44c7-a60f-e2a70f392284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 944 time: 0.0691876 Jun 17 11:13:39.719772 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-a17fa487-3c59-42e6-a0dc-de1386dcc492 req-a2300cee-8d16-4929-9b67-66c581c1b4b1 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0323679 Jun 17 11:13:39.766050 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 770bcd1d-11b2-4b20-b754-72ef4900bdad up at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Jun 17 11:13:39.885640 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning for port 770bcd1d-11b2-4b20-b754-72ef4900bdad completed by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Jun 17 11:13:39.890188 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.provisioning_blocks [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Provisioning complete for port 770bcd1d-11b2-4b20-b754-72ef4900bdad triggered by entity L2. {{(pid=110216) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Jun 17 11:13:39.890656 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-973056'] for port, provisioning_complete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:39.969170 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:39.991344 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '375d3e67-d829-4a23-be0d-2ba418784148', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '770bcd1d-11b2-4b20-b754-72ef4900bdad'}] {{(pid=110216) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:13:39.993610 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2bc2fcdae5632c233ee41e3d5b9365bc9026d54d312de648059c098e2b3f5e61" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c3c0e407-8098-46ac-80d9-dafa3e19957e" -d '{"events": [{"server_uuid": "375d3e67-d829-4a23-be0d-2ba418784148", "name": "network-vif-plugged", "status": "completed", "tag": "770bcd1d-11b2-4b20-b754-72ef4900bdad"}]}' {{(pid=110216) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:13:40.007243 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] For port 770bcd1d-11b2-4b20-b754-72ef4900bdad, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=770bcd1d-11b2-4b20-b754-72ef4900bdad,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:13:40.032318 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:13:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81fbc359-4f38-4be4-99ae-fe2ead5a48d1 x-openstack-request-id: req-81fbc359-4f38-4be4-99ae-fe2ead5a48d1 {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:13:40.032649 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "375d3e67-d829-4a23-be0d-2ba418784148", "name": "network-vif-plugged", "status": "completed", "tag": "770bcd1d-11b2-4b20-b754-72ef4900bdad", "code": 200}]} {{(pid=110216) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:13:40.032906 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-81fbc359-4f38-4be4-99ae-fe2ead5a48d1 {{(pid=110216) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:13:40.033302 dv-cinder-773870-6-iscsi neutron-server[110216]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '375d3e67-d829-4a23-be0d-2ba418784148', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '770bcd1d-11b2-4b20-b754-72ef4900bdad', 'code': 200} Jun 17 11:13:40.074406 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213'] for port, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:40.077044 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:13:40.124320 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Pushing event updated for resources: {'Port': ['ID=770bcd1d-11b2-4b20-b754-72ef4900bdad,revision_number=5']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:13:40.129525 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:13:40.505343 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64e62166-be09-499f-9457-d1dddfa0a5e7 req-ce3311b7-d87b-43ed-bf29-6e58b5840455 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:40.506823 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-64e62166-be09-499f-9457-d1dddfa0a5e7 req-ce3311b7-d87b-43ed-bf29-6e58b5840455 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 1098 time: 0.0672469 Jun 17 11:13:40.541717 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-64e62166-be09-499f-9457-d1dddfa0a5e7 req-3680ba88-4b28-45c0-b64b-9fae01a98883 service neutron] 10.222.0.25 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0279417 Jun 17 11:13:40.890638 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9e45630-a54d-4b59-80ab-e8745e6af91b req-06bf8e76-9c29-4cd7-ba81-fa512cd2a5a3 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:40.892122 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c9e45630-a54d-4b59-80ab-e8745e6af91b req-06bf8e76-9c29-4cd7-ba81-fa512cd2a5a3 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 945 time: 0.0620856 Jun 17 11:13:40.932033 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c9e45630-a54d-4b59-80ab-e8745e6af91b req-920e817c-c1f8-44d1-b788-f065d46dc8c2 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343370 Jun 17 11:13:42.102673 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-647ee204-48ba-4836-924d-1f6ecb679e40 req-f327d393-84be-4046-95a2-28728bd2a884 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:42.104152 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-647ee204-48ba-4836-924d-1f6ecb679e40 req-f327d393-84be-4046-95a2-28728bd2a884 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 945 time: 0.0625191 Jun 17 11:13:42.142198 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-647ee204-48ba-4836-924d-1f6ecb679e40 req-969e5371-3bb1-4fd2-bae9-09fcc5d80772 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0324006 Jun 17 11:13:42.309912 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c7f5c7-9d7c-4509-8374-e552215e756a req-52aba022-71ba-444b-be1e-48d1dc05f034 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:42.311423 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d3c7f5c7-9d7c-4509-8374-e552215e756a req-52aba022-71ba-444b-be1e-48d1dc05f034 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 945 time: 0.0632434 Jun 17 11:13:42.349280 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-d3c7f5c7-9d7c-4509-8374-e552215e756a req-95efc12d-2785-494a-a5ba-28931704ad82 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0323346 Jun 17 11:13:42.373715 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42850) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:13:42.517912 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2567f24-3593-49bd-9932-5c889b5954e7 tempest-TestVolumeBootPattern-1850253723 tempest-TestVolumeBootPattern-1850253723-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:42.519426 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-e2567f24-3593-49bd-9932-5c889b5954e7 tempest-TestVolumeBootPattern-1850253723 tempest-TestVolumeBootPattern-1850253723-project-admin] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 1093 time: 0.1447361 Jun 17 11:13:42.522335 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42854) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:13:42.526794 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.v2.base [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Request body: {'floatingip': {'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'port_id': '770bcd1d-11b2-4b20-b754-72ef4900bdad', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address': '172.20.0.4'}} {{(pid=110215) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Jun 17 11:13:42.628461 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:42.738616 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_before_create-931409'] for port, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:42.847139 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_common [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Allocated IP 172.27.3.125 (ae4da6f8-a7ac-4884-8d49-a1c679d58f18/f8350199-265a-4724-9d19-42e5cbbe0f87/3e42ee97-6d6e-45a2-95de-9cb47325e1b1) {{(pid=110215) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Jun 17 11:13:42.956028 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for port, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:43.120315 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_after_update-928404', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-25313', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8743357808150', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created-5898865'] for port, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:43.122405 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-fbc39416-565d-4b2e-bb62-c0bfca932679 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:13:43.160016 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Network ae4da6f8-a7ac-4884-8d49-a1c679d58f18 is already hosted by enough agents. {{(pid=110215) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Jun 17 11:13:43.170998 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.base_scheduler [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Resources bound (agent type, host, resource id): {{(pid=110215) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Jun 17 11:13:43.173513 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Received port after_create {{(pid=110215) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} Jun 17 11:13:43.176846 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'Port': ['ID=3e42ee97-6d6e-45a2-95de-9cb47325e1b1,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:13:43.200991 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:13:43.545046 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:43.605309 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3881823b-e364-4a2e-ba30-e521606ea104 req-083342ad-d5a0-453a-9864-b32c4460015e service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0896912 Jun 17 11:13:43.725208 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-931395'] for port, before_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:43.753192 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3881823b-e364-4a2e-ba30-e521606ea104 req-c35d78d9-48ed-4f1a-9563-554244fd0caa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:43.754642 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3881823b-e364-4a2e-ba30-e521606ea104 req-c35d78d9-48ed-4f1a-9563-554244fd0caa service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 1099 time: 0.1001749 Jun 17 11:13:43.927653 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3881823b-e364-4a2e-ba30-e521606ea104 req-743da4ca-1c6a-41a4-9065-24a9aae7a7d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:43.929263 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3881823b-e364-4a2e-ba30-e521606ea104 req-743da4ca-1c6a-41a4-9065-24a9aae7a7d2 service neutron] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 913 time: 0.1521428 Jun 17 11:13:43.984208 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for port, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:44.003527 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3881823b-e364-4a2e-ba30-e521606ea104 req-0f2e7e80-36d1-4f78-8d6d-5fdf0280e008 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=05c3d654-1803-4edd-9ea3-44a8afd65285 HTTP/1.1" status: 200 len: 1002 time: 0.0665727 Jun 17 11:13:44.052418 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3881823b-e364-4a2e-ba30-e521606ea104 req-349f21a0-0032-4ac6-a404-41e3fe7647eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:44.053865 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3881823b-e364-4a2e-ba30-e521606ea104 req-349f21a0-0032-4ac6-a404-41e3fe7647eb service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0428131 Jun 17 11:13:44.091386 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8743358265447', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8743357808168', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8743357808213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5898819'] for port, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:44.094614 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-31dbf8d3-f540-4ba8-9965-e50956882c7e tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:13:44.169518 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event updated for resources: {'Port': ['ID=3e42ee97-6d6e-45a2-95de-9cb47325e1b1,revision_number=2']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:13:44.175597 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:13:44.188672 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:44.191368 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3881823b-e364-4a2e-ba30-e521606ea104 req-76892e9b-1ba4-4fb0-b5f9-d9105347bfd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:44.192934 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3881823b-e364-4a2e-ba30-e521606ea104 req-76892e9b-1ba4-4fb0-b5f9-d9105347bfd6 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1319988 Jun 17 11:13:44.355823 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.l3_db [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Floating IP 274d0d74-d6f1-48be-a386-56b1f33cbbe1 associated. External IP: 172.27.3.125, port: 770bcd1d-11b2-4b20-b754-72ef4900bdad. Jun 17 11:13:44.361495 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3881823b-e364-4a2e-ba30-e521606ea104 req-ad195fd5-e64a-4a1c-81f4-1ed414eb3198 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1343710 Jun 17 11:13:44.522818 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-3881823b-e364-4a2e-ba30-e521606ea104 req-437e1ea3-05f9-4d07-9ef4-c29be21ebec2 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1323323 Jun 17 11:13:44.629056 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:13:44.740703 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:13:44.750094 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b428872a-a595-4bce-8e72-1895307ee7e4 None None] Sync routers for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:13:44.759426 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b428872a-a595-4bce-8e72-1895307ee7e4 None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:13:44.760047 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-b428872a-a595-4bce-8e72-1895307ee7e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:13:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:13:44.836366 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:44.863196 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-b428872a-a595-4bce-8e72-1895307ee7e4 None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:13:44.872963 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.3495631 Jun 17 11:13:44.873613 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '375d3e67-d829-4a23-be0d-2ba418784148', 'tag': '770bcd1d-11b2-4b20-b754-72ef4900bdad'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:13:44.875939 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8da409e1-ae03-41e1-97dd-7396b55fe773" -d '{"events": [{"name": "network-changed", "server_uuid": "375d3e67-d829-4a23-be0d-2ba418784148", "tag": "770bcd1d-11b2-4b20-b754-72ef4900bdad"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:13:44.913383 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:13:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95c7284f-bbb0-47f6-8eb1-f40e6ddd75cc x-openstack-request-id: req-95c7284f-bbb0-47f6-8eb1-f40e6ddd75cc {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:13:44.913780 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "375d3e67-d829-4a23-be0d-2ba418784148", "tag": "770bcd1d-11b2-4b20-b754-72ef4900bdad", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:13:44.914079 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-95c7284f-bbb0-47f6-8eb1-f40e6ddd75cc {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:13:44.914519 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '375d3e67-d829-4a23-be0d-2ba418784148', 'tag': '770bcd1d-11b2-4b20-b754-72ef4900bdad', 'status': 'completed', 'code': 200} Jun 17 11:13:44.991856 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8da409e1-ae03-41e1-97dd-7396b55fe773 req-9a61c5d5-180d-4c28-a6cc-ad46f02f488e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:44.993374 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8da409e1-ae03-41e1-97dd-7396b55fe773 req-9a61c5d5-180d-4c28-a6cc-ad46f02f488e service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 1098 time: 0.0525136 Jun 17 11:13:45.084849 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-b428872a-a595-4bce-8e72-1895307ee7e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '274d0d74-d6f1-48be-a386-56b1f33cbbe1', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.125', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '770bcd1d-11b2-4b20-b754-72ef4900bdad', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:1e:84:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '375d3e67-d829-4a23-be0d-2ba418784148', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:13:43Z', 'updated_at': '2021-06-17T11:13:43Z', 'revision_number': 0, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}, {'id': 'e73e0dd6-cc1b-4554-94ac-70a98e85d0fe', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.216', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:5b:e8:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:42Z', 'updated_at': '2021-06-17T11:10:44Z', 'revision_number': 1, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:13:45.085549 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8da409e1-ae03-41e1-97dd-7396b55fe773 req-5698cdd6-937b-47a3-b0c7-8aae09b6478c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:45.087801 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8da409e1-ae03-41e1-97dd-7396b55fe773 req-5698cdd6-937b-47a3-b0c7-8aae09b6478c service neutron] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 913 time: 0.0864568 Jun 17 11:13:45.110545 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b428872a-a595-4bce-8e72-1895307ee7e4 None None] Checking router: 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:13:45.119135 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b428872a-a595-4bce-8e72-1895307ee7e4 None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:13:45.119746 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-b428872a-a595-4bce-8e72-1895307ee7e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:13:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:13:45.155786 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8da409e1-ae03-41e1-97dd-7396b55fe773 req-ed776d9e-3a4e-4f30-9eb2-2b7e6c046b4f service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=770bcd1d-11b2-4b20-b754-72ef4900bdad HTTP/1.1" status: 200 len: 999 time: 0.0609419 Jun 17 11:13:45.205369 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8da409e1-ae03-41e1-97dd-7396b55fe773 req-ff29ad72-600a-47d2-9fce-f450122524c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:45.206834 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8da409e1-ae03-41e1-97dd-7396b55fe773 req-ff29ad72-600a-47d2-9fce-f450122524c8 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0446494 Jun 17 11:13:45.220592 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-b428872a-a595-4bce-8e72-1895307ee7e4 None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:13:45.266131 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8da409e1-ae03-41e1-97dd-7396b55fe773 req-a04e787f-b539-4907-b1c8-21dd312084a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:13:45.267764 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8da409e1-ae03-41e1-97dd-7396b55fe773 req-a04e787f-b539-4907-b1c8-21dd312084a2 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0532126 Jun 17 11:13:45.449779 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-b428872a-a595-4bce-8e72-1895307ee7e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '274d0d74-d6f1-48be-a386-56b1f33cbbe1', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.125', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '770bcd1d-11b2-4b20-b754-72ef4900bdad', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:1e:84:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '375d3e67-d829-4a23-be0d-2ba418784148', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:13:43Z', 'updated_at': '2021-06-17T11:13:43Z', 'revision_number': 0, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}, {'id': 'e73e0dd6-cc1b-4554-94ac-70a98e85d0fe', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.216', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:5b:e8:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:42Z', 'updated_at': '2021-06-17T11:10:44Z', 'revision_number': 1, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:13:45.574512 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b428872a-a595-4bce-8e72-1895307ee7e4 None None] The sync data for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi is: [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': '274d0d74-d6f1-48be-a386-56b1f33cbbe1', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.125', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '770bcd1d-11b2-4b20-b754-72ef4900bdad', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 642, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:1e:84:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '375d3e67-d829-4a23-be0d-2ba418784148', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:13:43Z', 'updated_at': '2021-06-17T11:13:43Z', 'revision_number': 0, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}, {'id': 'e73e0dd6-cc1b-4554-94ac-70a98e85d0fe', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.216', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:5b:e8:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:42Z', 'updated_at': '2021-06-17T11:10:44Z', 'revision_number': 1, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:13:45.638321 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8da409e1-ae03-41e1-97dd-7396b55fe773 req-2a32bed0-7f92-4189-8874-b53fa579bd3b service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3614359 Jun 17 11:13:45.730711 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8da409e1-ae03-41e1-97dd-7396b55fe773 req-5f5800f4-aadb-4586-ba20-f9310b8d3203 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845289 Jun 17 11:13:45.770801 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f4f07d-0c8a-4b5f-a17e-84c54ec04bb1 None None] New status for floating IP 274d0d74-d6f1-48be-a386-56b1f33cbbe1: ACTIVE {{(pid=110216) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:13:50.711272 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-b8833d59-76c8-41ff-9e06-ba409e40e1f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:53.371594 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-cf1e214c-cdf4-4206-b98b-08b14390acfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:53.673994 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:54.555952 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:56.833581 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:13:58.036704 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:14:07.795775 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:20.652443 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6e885ac2-d657-499e-ad34-e61926935bf3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:23.336052 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-fcd94977-e516-4d97-8d4f-7d1b18d1490c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:23.624252 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:24.527006 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:26.832832 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:29.330421 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4621f06c-449a-4c37-af37-18f51d1972d6 req-d38fa006-fe2b-4443-b6a1-b222fbf36128 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:14:29.331906 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4621f06c-449a-4c37-af37-18f51d1972d6 req-d38fa006-fe2b-4443-b6a1-b222fbf36128 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 946 time: 0.0631289 Jun 17 11:14:29.368247 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-4621f06c-449a-4c37-af37-18f51d1972d6 req-1744a652-5cd4-40ee-8f78-88d8977330fd tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0307183 Jun 17 11:14:30.556902 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e6a4d3f-ce96-4fd4-9a4c-6435420f85f2 req-ba6093d5-b8e6-4465-84b4-bf95e2c6968a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:14:30.558339 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1e6a4d3f-ce96-4fd4-9a4c-6435420f85f2 req-ba6093d5-b8e6-4465-84b4-bf95e2c6968a tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 946 time: 0.0634623 Jun 17 11:14:30.597784 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1e6a4d3f-ce96-4fd4-9a4c-6435420f85f2 req-2c6b3ed1-2386-45bd-9316-29def61f8562 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups?id=f272e923-d002-45f5-b360-fe53bbf06fd6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0337882 Jun 17 11:14:30.850823 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-58f6afc4-cc94-40ba-8067-af51ce60b344 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:14:30.852148 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-58f6afc4-cc94-40ba-8067-af51ce60b344 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.25 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 946 time: 0.0598280 Jun 17 11:14:30.945051 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Deleting port bb8e800d-0d92-4757-af24-da32b3db8d82 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:14:30.945388 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:31.031314 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] For port bb8e800d-0d92-4757-af24-da32b3db8d82, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=bb8e800d-0d92-4757-af24-da32b3db8d82,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:14:31.031673 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:31.192876 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, precommit_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:31.193159 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-8286681'] for floatingip, after_update {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:31.193461 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.l3_db [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Floating IP d0828cf5-defc-4c2c-8ddb-25ca72755d92 disassociated. External IP: 172.27.3.106, port: bb8e800d-0d92-4757-af24-da32b3db8d82. Jun 17 11:14:31.193791 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Calling delete_port for bb8e800d-0d92-4757-af24-da32b3db8d82 owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:14:31.418314 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:31.422505 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0355535c-2d1f-434e-86ec-1df1055d41e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:14:31.451895 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event deleted for resources: {'Port': ['ID=bb8e800d-0d92-4757-af24-da32b3db8d82,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:14:31.460686 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.461060 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.461448 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.461788 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.462154 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.462538 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.462916 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.463268 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.463622 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.463975 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.464326 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.464672 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:31.468113 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:14:31.573031 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Router a0be9488-bc15-4149-b213-8c5540303580 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:14:31.677424 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:14:31.689340 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-351429e5-baaa-4704-9e90-385f85534b49 None None] Sync routers for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:14:31.701105 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-351429e5-baaa-4704-9e90-385f85534b49 None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:14:31.701733 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-351429e5-baaa-4704-9e90-385f85534b49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:14:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:14:31.720226 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] No DVR routers for this DVR port bb8e800d-0d92-4757-af24-da32b3db8d82 on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:14:31.722689 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:31.725091 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-4221fd17-083d-4724-bb67-0c111beb7a64 req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.25 "DELETE /v2.0/ports/bb8e800d-0d92-4757-af24-da32b3db8d82 HTTP/1.1" status: 204 len: 173 time: 0.8673289 Jun 17 11:14:31.725301 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'name': 'network-vif-deleted', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:14:31.727683 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40b152ec-fca3-402c-b479-de3637f97c9b" -d '{"events": [{"server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "name": "network-vif-deleted", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:14:31.756415 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ef742df0-8f2d-40fe-b853-191845f02ee6 req-f982161b-af35-499f-923d-ac8f52fd045d tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/ports?device_id=4201dabd-0998-4ba5-b16f-901ed086f4f1 HTTP/1.1" status: 200 len: 210 time: 0.0412974 Jun 17 11:14:31.766104 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:14:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c1bf43b-264d-421d-b102-649b3f201cbf x-openstack-request-id: req-5c1bf43b-264d-421d-b102-649b3f201cbf {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:14:31.766461 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4201dabd-0998-4ba5-b16f-901ed086f4f1", "name": "network-vif-deleted", "tag": "bb8e800d-0d92-4757-af24-da32b3db8d82", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:14:31.766751 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-5c1bf43b-264d-421d-b102-649b3f201cbf {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:14:31.767219 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4201dabd-0998-4ba5-b16f-901ed086f4f1', 'name': 'network-vif-deleted', 'tag': 'bb8e800d-0d92-4757-af24-da32b3db8d82', 'status': 'completed', 'code': 200} Jun 17 11:14:31.812228 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-351429e5-baaa-4704-9e90-385f85534b49 None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:14:32.007450 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-351429e5-baaa-4704-9e90-385f85534b49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:14:32.036565 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-351429e5-baaa-4704-9e90-385f85534b49 None None] Checking router: a0be9488-bc15-4149-b213-8c5540303580 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:14:32.045260 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-351429e5-baaa-4704-9e90-385f85534b49 None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:14:32.045880 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-351429e5-baaa-4704-9e90-385f85534b49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:14:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:14:32.142632 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-351429e5-baaa-4704-9e90-385f85534b49 None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:14:32.334683 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-351429e5-baaa-4704-9e90-385f85534b49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:14:32.363078 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-351429e5-baaa-4704-9e90-385f85534b49 None None] The sync data for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi is: [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:05:11Z', 'revision_number': 4, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '753daf15-efa7-44ee-bf2d-02e931a5402f', 'name': '', 'network_id': '68556f75-deee-4c64-96a7-37433fd16432', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'mac_address': 'fa:16:3e:05:80:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_interface', 'standard_attr_id': 525, 'fixed_ips': [{'subnet_id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:11Z', 'updated_at': '2021-06-17T11:05:16Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'subnets': [{'id': '2af00aea-d778-4108-9ac2-b4c1362392ec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:14:32.577980 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c7b469e-1350-46d9-9583-9d9eeacc49d8 None None] New status for floating IP d0828cf5-defc-4c2c-8ddb-25ca72755d92: DOWN {{(pid=110216) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:14:33.016112 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42908) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:14:33.068743 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9463966d-7507-4a06-aea4-292d61a5e862 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:33.090927 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9463966d-7507-4a06-aea4-292d61a5e862 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:33.257611 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9463966d-7507-4a06-aea4-292d61a5e862 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:33.260196 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9463966d-7507-4a06-aea4-292d61a5e862 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:33.261344 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-9463966d-7507-4a06-aea4-292d61a5e862 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "DELETE /v2.0/security-groups/f272e923-d002-45f5-b360-fe53bbf06fd6 HTTP/1.1" status: 204 len: 168 time: 0.2442589 Jun 17 11:14:33.262391 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-327e2718-9340-4351-98e2-4fc643484e16 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:14:33.265738 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42910) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:14:33.283959 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.api.v2.resource [None req-5f8dd4fa-56e0-4025-98cc-252da1af0910 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] show failed (client error): The resource could not be found. Jun 17 11:14:33.284908 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-5f8dd4fa-56e0-4025-98cc-252da1af0910 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "GET /v2.0/security-groups/f272e923-d002-45f5-b360-fe53bbf06fd6 HTTP/1.1" status: 404 len: 347 time: 0.0179749 Jun 17 11:14:33.285837 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9463966d-7507-4a06-aea4-292d61a5e862 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f272e923-d002-45f5-b360-fe53bbf06fd6,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:14:33.287905 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 42912) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:14:33.288422 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9463966d-7507-4a06-aea4-292d61a5e862 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:14:33.405927 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Deleting port 7f48f70b-b11a-4225-b989-644c971f76eb {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:14:33.406286 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:33.478310 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:33.478628 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:33.543625 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Calling delete_port for 7f48f70b-b11a-4225-b989-644c971f76eb owned by network:floatingip {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:14:33.752855 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:33.755023 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-922b4d12-6287-40fa-bd5f-aa6da8c4e500 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:14:33.779565 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Pushing event deleted for resources: {'Port': ['ID=7f48f70b-b11a-4225-b989-644c971f76eb,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:14:33.803739 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.804117 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.804488 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.804857 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.805216 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.805579 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.805940 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.806302 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.806653 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.807028 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.812481 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.812481 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:33.812722 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:14:33.847011 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks [] for floatingip, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:33.849494 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:33.850580 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-6974fca4-0289-4307-9a93-12e65e170161 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] 10.222.0.41 "DELETE /v2.0/floatingips/d0828cf5-defc-4c2c-8ddb-25ca72755d92 HTTP/1.1" status: 204 len: 168 time: 0.5616519 Jun 17 11:14:34.017219 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device bb8e800d-0d92-4757-af24-da32b3db8d82 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:14:34.040345 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: bb8e800d-0d92-4757-af24-da32b3db8d82 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:14:34.040699 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device bb8e800d-0d92-4757-af24-da32b3db8d82 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:14:35.035957 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:14:36.687530 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42936) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:14:37.110268 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8355326'] for router_interface, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:37.354219 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] Deleting port 753daf15-efa7-44ee-bf2d-02e931a5402f {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:14:37.354552 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:37.431694 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] For port 753daf15-efa7-44ee-bf2d-02e931a5402f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=753daf15-efa7-44ee-bf2d-02e931a5402f,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:14:37.431988 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:37.491498 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] Calling delete_port for 753daf15-efa7-44ee-bf2d-02e931a5402f owned by network:router_interface {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:14:37.721092 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:37.724054 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-d8ccaaa5-82a0-4b5f-951d-4f004c135795 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:14:37.751068 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] Pushing event deleted for resources: {'Port': ['ID=753daf15-efa7-44ee-bf2d-02e931a5402f,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:14:37.754991 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:14:37.801198 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:37.911810 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7899567', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8355178'] for router_interface, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:38.113854 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] Router a0be9488-bc15-4149-b213-8c5540303580 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:14:38.216343 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:14:38.221198 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-5a160806-fa79-4f40-841e-ce1e3a67de48 admin admin] 10.222.0.41 "PUT /v2.0/routers/a0be9488-bc15-4149-b213-8c5540303580/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5324855 Jun 17 11:14:38.224157 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42940) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:14:38.227291 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-190f07d4-8f54-4110-831e-be3b19a381fd None None] Sync routers for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:14:38.238496 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-190f07d4-8f54-4110-831e-be3b19a381fd None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:14:38.239159 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-190f07d4-8f54-4110-831e-be3b19a381fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:14:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:14:38.332753 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Notify callbacks [] for router, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:38.340253 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-190f07d4-8f54-4110-831e-be3b19a381fd None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:14:38.436384 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:38.516372 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-190f07d4-8f54-4110-831e-be3b19a381fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:14:37Z', 'revision_number': 5, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port': {'id': '512d31d3-8533-49cd-b207-ad06c26ab2db', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:dc:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0be9488-bc15-4149-b213-8c5540303580', 'device_owner': 'network:router_gateway', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:05:09Z', 'updated_at': '2021-06-17T11:05:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:14:38.540761 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-190f07d4-8f54-4110-831e-be3b19a381fd None None] Checking router: a0be9488-bc15-4149-b213-8c5540303580 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:14:38.549169 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-190f07d4-8f54-4110-831e-be3b19a381fd None None] Routers {'a0be9488-bc15-4149-b213-8c5540303580'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:14:38.549782 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-190f07d4-8f54-4110-831e-be3b19a381fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:14:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['a0be9488-bc15-4149-b213-8c5540303580'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:14:38.567159 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Deleting port 512d31d3-8533-49cd-b207-ad06c26ab2db {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:14:38.571180 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:38.630983 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-190f07d4-8f54-4110-831e-be3b19a381fd None None] Set router a0be9488-bc15-4149-b213-8c5540303580 gateway port host: None {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:14:38.660901 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] For port 512d31d3-8533-49cd-b207-ad06c26ab2db, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=512d31d3-8533-49cd-b207-ad06c26ab2db,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:14:38.661255 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:38.686065 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-190f07d4-8f54-4110-831e-be3b19a381fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:14:38Z', 'revision_number': 6, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port_host': None}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:14:38.730791 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Calling delete_port for 512d31d3-8533-49cd-b207-ad06c26ab2db owned by network:router_gateway {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:14:38.799319 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-190f07d4-8f54-4110-831e-be3b19a381fd None None] The sync data for ids ['a0be9488-bc15-4149-b213-8c5540303580'] in dv-cinder-773870-6-iscsi is: [{'id': 'a0be9488-bc15-4149-b213-8c5540303580', 'name': 'tempest-AttachVolumeShelveTestJSON-1195616325-router', 'tenant_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:05:08Z', 'updated_at': '2021-06-17T11:14:38Z', 'revision_number': 6, 'project_id': 'e96eb64d17bd425d9b0a15bc07c55136', 'gw_port_host': None}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:14:38.958462 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:38.961196 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-fff34821-28f9-440a-ac68-55177f9cd9a7 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:14:38.989652 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Pushing event deleted for resources: {'Port': ['ID=512d31d3-8533-49cd-b207-ad06c26ab2db,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:14:38.993459 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:14:39.056954 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8286505'] for router_gateway, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:39.148531 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8357994', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2026'] for router, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:39.150988 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:39.530766 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8291427'] for router, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:39.531191 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a0be9488-bc15-4149-b213-8c5540303580 {{(pid=110215) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Jun 17 11:14:39.535379 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] Notify callbacks [] for router, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:39.536568 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-370ad66b-de63-4859-9414-c4dcc429ad97 admin admin] 10.222.0.41 "DELETE /v2.0/routers/a0be9488-bc15-4149-b213-8c5540303580 HTTP/1.1" status: 204 len: 168 time: 1.3114343 Jun 17 11:14:39.539085 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42942) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:14:39.582064 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.db_base_plugin_v2 [None req-04172579-77bc-4684-a264-d46f6484f8eb admin admin] Deleting subnet 2af00aea-d778-4108-9ac2-b4c1362392ec {{(pid=110215) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:14:39.585133 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-04172579-77bc-4684-a264-d46f6484f8eb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:39.619011 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-04172579-77bc-4684-a264-d46f6484f8eb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6032829'] for subnet, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:39.700084 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-04172579-77bc-4684-a264-d46f6484f8eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:39.890376 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-04172579-77bc-4684-a264-d46f6484f8eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5898882', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5636066'] for subnet, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:39.892658 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bc82e473-57ed-41b8-a06e-60a1753752e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:14:39.916209 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04172579-77bc-4684-a264-d46f6484f8eb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2af00aea-d778-4108-9ac2-b4c1362392ec,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:14:39.919345 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-04172579-77bc-4684-a264-d46f6484f8eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:14:39.920315 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-04172579-77bc-4684-a264-d46f6484f8eb admin admin] Notify callbacks [] for subnet, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:39.922121 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-04172579-77bc-4684-a264-d46f6484f8eb admin admin] 10.222.0.41 "DELETE /v2.0/subnets/2af00aea-d778-4108-9ac2-b4c1362392ec HTTP/1.1" status: 204 len: 168 time: 0.3820729 Jun 17 11:14:39.924812 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 42944) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:14:39.928191 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b46c64ff-17c1-4262-a71e-680a7dea6202 None None] Network 68556f75-deee-4c64-96a7-37433fd16432 requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:14:39.992689 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.044458 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Deleting port ee69616f-d3d6-487f-beab-300cabda1d0f {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:14:40.044769 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.117290 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] For port ee69616f-d3d6-487f-beab-300cabda1d0f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=ee69616f-d3d6-487f-beab-300cabda1d0f,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:14:40.117657 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.118125 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] DHCP port deletion for 68556f75-deee-4c64-96a7-37433fd16432 request from dv-cinder-773870-6-iscsi {{(pid=110216) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Jun 17 11:14:40.163161 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Deleting port ee69616f-d3d6-487f-beab-300cabda1d0f {{(pid=110216) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:14:40.163545 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.184290 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Calling delete_port for ee69616f-d3d6-487f-beab-300cabda1d0f owned by network:dhcp {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:14:40.224367 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] For port ee69616f-d3d6-487f-beab-300cabda1d0f, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=ee69616f-d3d6-487f-beab-300cabda1d0f,segment=NetworkSegment(a39bef7f-0015-4ba7-8bea-9565729cbb43),segment_id=a39bef7f-0015-4ba7-8bea-9565729cbb43)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:14:40.224769 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.289034 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Calling delete_port for ee69616f-d3d6-487f-beab-300cabda1d0f owned by network:dhcp {{(pid=110216) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:14:40.324281 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.326378 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-985fe14d-2497-426e-a649-07c83df36e9c tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:14:40.348602 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Pushing event deleted for resources: {'Port': ['ID=ee69616f-d3d6-487f-beab-300cabda1d0f,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:14:40.351565 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:14:40.355807 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] No DVR routers for this DVR port ee69616f-d3d6-487f-beab-300cabda1d0f on host dv-cinder-773870-6-iscsi {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:14:40.369710 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159'] for port, after_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.371831 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:14:40.395795 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Pushing event deleted for resources: {'Port': ['ID=ee69616f-d3d6-487f-beab-300cabda1d0f,revision_number=None']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:14:40.402963 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] No DVR routers for this DVR port ee69616f-d3d6-487f-beab-300cabda1d0f on host dv-cinder-773870-6-iscsi {{(pid=110216) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:14:40.405809 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.406371 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.406716 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.407203 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.407542 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.408458 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.408458 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.408753 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.408864 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.409135 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.409455 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.409780 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:14:40.413474 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-780ec0af-c5e2-4176-9c2d-610d68e5c749 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:14:40.430996 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 753daf15-efa7-44ee-bf2d-02e931a5402f no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:14:40.437351 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.446294 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 753daf15-efa7-44ee-bf2d-02e931a5402f {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:14:40.446647 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 753daf15-efa7-44ee-bf2d-02e931a5402f not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:14:40.447098 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device ee69616f-d3d6-487f-beab-300cabda1d0f no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:14:40.447402 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['68556f75-deee-4c64-96a7-37433fd16432']}} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:14:40.462196 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a39bef7f-0015-4ba7-8bea-9565729cbb43') {'for_net_delete': True} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:14:40.462481 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a39bef7f-0015-4ba7-8bea-9565729cbb43') {} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:14:40.465462 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: ee69616f-d3d6-487f-beab-300cabda1d0f {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:14:40.466406 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device ee69616f-d3d6-487f-beab-300cabda1d0f not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:14:40.466839 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 512d31d3-8533-49cd-b207-ad06c26ab2db no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:14:40.472119 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6032818'] for segment, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.485436 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 512d31d3-8533-49cd-b207-ad06c26ab2db {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:14:40.485791 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 512d31d3-8533-49cd-b207-ad06c26ab2db not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:14:40.487482 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.494070 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Releasing vlan 116 on physical network physnet1 to pool {{(pid=110215) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:14:40.494458 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5898799'] for segment, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:114: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: conditions |= (models_v2.Port.network_id.in_( Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: /opt/stack/neutron/neutron/services/revisions/revision_plugin.py:194: SAWarning: TypeDecorator TruncatedDateTime() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: retrieve_revision_numbers = { Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: Traceback (most recent call last): Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: timer() Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: cb(*args, **kw) Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: return func(*args, **kwargs) Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: self._notify() Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: self.callback(batched_events) Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: event.method(event) Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: return f(self, *a, **k) Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._get(url).json() Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: return self.request(url, 'GET', **kwargs) Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:14:40.496339 dv-cinder-773870-6-iscsi neutron-server[110215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:14:40.617597 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.621722 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6d77a41f-9f25-4511-8c05-6b6f36627aca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:14:40.628609 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:40.628609 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] 10.222.0.41 "DELETE /v2.0/networks/68556f75-deee-4c64-96a7-37433fd16432 HTTP/1.1" status: 204 len: 168 time: 0.7002993 Jun 17 11:14:40.636277 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Pushing event deleted for resources: {'Network': ['ID=68556f75-deee-4c64-96a7-37433fd16432,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:14:40.639430 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:14:40.919397 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 42948) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:14:40.958587 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-81b2dbd0-8abf-41cd-9751-0f821335c143 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=e96eb64d17bd425d9b0a15bc07c55136&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0379927 Jun 17 11:14:40.960790 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 42950) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:14:41.006414 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0a4c9d06-8bfb-4723-a691-75669e92292b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:41.031027 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0a4c9d06-8bfb-4723-a691-75669e92292b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:41.147544 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0a4c9d06-8bfb-4723-a691-75669e92292b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:41.150433 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0a4c9d06-8bfb-4723-a691-75669e92292b admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:41.151677 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-0a4c9d06-8bfb-4723-a691-75669e92292b admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/3f3cf50f-e16f-47f6-b58a-29f6d9c4ab3f HTTP/1.1" status: 204 len: 168 time: 0.1900198 Jun 17 11:14:41.152576 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5f305ba1-81be-4d0a-8dd0-399bdd4484f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:14:41.160186 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a4c9d06-8bfb-4723-a691-75669e92292b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f3cf50f-e16f-47f6-b58a-29f6d9c4ab3f,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:14:41.162705 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0a4c9d06-8bfb-4723-a691-75669e92292b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:14:45.007753 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8007d18d-e577-4332-872e-7c2e6a440558 req-afc0576a-b605-4555-86f3-557f5dab9ca0 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1511827 Jun 17 11:14:45.085671 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8007d18d-e577-4332-872e-7c2e6a440558 req-3bb0e36b-09cb-4825-a16e-c696504ff5ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:14:45.087162 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8007d18d-e577-4332-872e-7c2e6a440558 req-3bb0e36b-09cb-4825-a16e-c696504ff5ad service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 1098 time: 0.0554373 Jun 17 11:14:45.193494 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8007d18d-e577-4332-872e-7c2e6a440558 req-d0bba949-4e67-49a4-851f-352c0888e2c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:14:45.195012 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8007d18d-e577-4332-872e-7c2e6a440558 req-d0bba949-4e67-49a4-851f-352c0888e2c2 service neutron] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 913 time: 0.0867085 Jun 17 11:14:45.266114 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8007d18d-e577-4332-872e-7c2e6a440558 req-a623f1d1-3420-4af9-81e8-87ee7d954fb0 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=770bcd1d-11b2-4b20-b754-72ef4900bdad HTTP/1.1" status: 200 len: 1001 time: 0.0643148 Jun 17 11:14:45.315053 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8007d18d-e577-4332-872e-7c2e6a440558 req-f5d4b3e0-fdd9-4b1e-902d-77dc48f5ce60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:14:45.316469 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8007d18d-e577-4332-872e-7c2e6a440558 req-f5d4b3e0-fdd9-4b1e-902d-77dc48f5ce60 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0443444 Jun 17 11:14:45.375243 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8007d18d-e577-4332-872e-7c2e6a440558 req-99d50255-4618-4105-8c6c-c00515a59f30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:14:45.377009 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8007d18d-e577-4332-872e-7c2e6a440558 req-99d50255-4618-4105-8c6c-c00515a59f30 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0531631 Jun 17 11:14:45.471366 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8007d18d-e577-4332-872e-7c2e6a440558 req-ad4456bd-4ae4-4caf-9aa4-d892f1dafcbe service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0872586 Jun 17 11:14:45.562350 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-8007d18d-e577-4332-872e-7c2e6a440558 req-aff39bb2-272a-486f-bdb1-88b5ffcce96d service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846388 Jun 17 11:14:50.686559 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f85a5edc-3d98-43d3-a08b-111c8a44e3b6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:53.369982 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-39861b3b-c56b-4034-80d6-0cac1ce5274c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:53.669417 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:54.506663 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:14:56.834820 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:02.165324 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43172) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:02.271247 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2076b494-b953-4174-be51-bba7c9397513 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:02.359202 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2076b494-b953-4174-be51-bba7c9397513 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:02.480098 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-2076b494-b953-4174-be51-bba7c9397513 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:02.483125 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-027376a2-99f8-49ef-87eb-ac0696b57d91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:02.522193 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-2076b494-b953-4174-be51-bba7c9397513 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=e957f0c5a8c444578a34faee7376b487&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3556826 Jun 17 11:15:02.523090 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2076b494-b953-4174-be51-bba7c9397513 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=52e0958f-d304-4ec3-b6d0-caebb7d4ce9b,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:02.524973 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43176) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:02.526240 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-2076b494-b953-4174-be51-bba7c9397513 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:02.581259 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-18167813-f13b-4a3d-bb21-79a6e077b254 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:02.601568 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-18167813-f13b-4a3d-bb21-79a6e077b254 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:02.725965 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-18167813-f13b-4a3d-bb21-79a6e077b254 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:02.728578 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-18167813-f13b-4a3d-bb21-79a6e077b254 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:02.729697 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-18167813-f13b-4a3d-bb21-79a6e077b254 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/52e0958f-d304-4ec3-b6d0-caebb7d4ce9b HTTP/1.1" status: 204 len: 168 time: 0.2031438 Jun 17 11:15:02.730474 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8fb68b45-d6b0-41b2-b3c3-a8295bc07e0f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:02.738298 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18167813-f13b-4a3d-bb21-79a6e077b254 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=52e0958f-d304-4ec3-b6d0-caebb7d4ce9b,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:02.740695 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-18167813-f13b-4a3d-bb21-79a6e077b254 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:03.343410 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43182) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:03.356630 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-466da482-eaba-4173-a966-d93f3a9f49a1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:03.443391 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-466da482-eaba-4173-a966-d93f3a9f49a1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:03.497909 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-466da482-eaba-4173-a966-d93f3a9f49a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:03.501388 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-a1d2c324-28f7-49d6-aa8e-3c7457361368 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:03.546329 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-466da482-eaba-4173-a966-d93f3a9f49a1 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=02a450f2d9c3478b9b0697455a67eebf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2013793 Jun 17 11:15:03.548463 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-466da482-eaba-4173-a966-d93f3a9f49a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92564ef7-b4bb-46d4-af42-48e011fd4d31,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:03.548803 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43184) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:03.552691 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-466da482-eaba-4173-a966-d93f3a9f49a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:03.606814 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9144c467-84e2-43a3-98ea-9ce592f6d065 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:03.630269 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9144c467-84e2-43a3-98ea-9ce592f6d065 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:03.754138 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9144c467-84e2-43a3-98ea-9ce592f6d065 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:03.756745 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-9144c467-84e2-43a3-98ea-9ce592f6d065 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:03.757883 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-9144c467-84e2-43a3-98ea-9ce592f6d065 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/92564ef7-b4bb-46d4-af42-48e011fd4d31 HTTP/1.1" status: 204 len: 168 time: 0.2080493 Jun 17 11:15:03.758832 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-f6a5a010-f785-4d21-8f15-057fd042f35e tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:03.766653 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9144c467-84e2-43a3-98ea-9ce592f6d065 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92564ef7-b4bb-46d4-af42-48e011fd4d31,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:03.769496 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-9144c467-84e2-43a3-98ea-9ce592f6d065 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:07.783149 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:08.020814 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43252) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:08.122748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b4efc888-3987-4883-bead-45ee51e0f4aa admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:08.211892 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b4efc888-3987-4883-bead-45ee51e0f4aa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:08.254592 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-b4efc888-3987-4883-bead-45ee51e0f4aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:08.257916 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-6fa84391-e9f4-4642-a428-d6d1eca986be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:08.295126 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-b4efc888-3987-4883-bead-45ee51e0f4aa admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=051fb122c6eb43d19f92ad734f16e995&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2731757 Jun 17 11:15:08.296283 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4efc888-3987-4883-bead-45ee51e0f4aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75d9c270-b426-4f83-9620-d588fe333baf,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:08.298074 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43256) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:08.299820 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-b4efc888-3987-4883-bead-45ee51e0f4aa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:08.349964 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d3a90b58-f433-487a-9938-f755a48d2443 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:08.371493 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d3a90b58-f433-487a-9938-f755a48d2443 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:08.495074 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d3a90b58-f433-487a-9938-f755a48d2443 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:08.498222 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d3a90b58-f433-487a-9938-f755a48d2443 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:08.499416 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-d3a90b58-f433-487a-9938-f755a48d2443 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/75d9c270-b426-4f83-9620-d588fe333baf HTTP/1.1" status: 204 len: 168 time: 0.1995747 Jun 17 11:15:08.500299 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0a4c9d06-8bfb-4723-a691-75669e92292b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:08.508142 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a90b58-f433-487a-9938-f755a48d2443 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75d9c270-b426-4f83-9620-d588fe333baf,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:08.510506 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d3a90b58-f433-487a-9938-f755a48d2443 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:09.084831 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43262) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:09.102923 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bbac5341-84e1-470c-bf71-7ae13363dd94 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:09.195315 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bbac5341-84e1-470c-bf71-7ae13363dd94 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:09.268302 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-bbac5341-84e1-470c-bf71-7ae13363dd94 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:09.270822 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4ce82a6f-5563-45eb-9efc-648d57c2ff39 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:09.307003 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-bbac5341-84e1-470c-bf71-7ae13363dd94 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=5ef365384f2a4600a4fa50f304691267&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2205424 Jun 17 11:15:09.307859 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbac5341-84e1-470c-bf71-7ae13363dd94 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff83be87-679a-4b09-8d3f-add2103f1ac1,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:09.311066 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43264) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:09.311558 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bbac5341-84e1-470c-bf71-7ae13363dd94 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:09.361653 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1dbdfb63-81f2-4367-b77b-660d981dd87c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:09.382096 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1dbdfb63-81f2-4367-b77b-660d981dd87c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:09.489847 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1dbdfb63-81f2-4367-b77b-660d981dd87c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:09.492523 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-1dbdfb63-81f2-4367-b77b-660d981dd87c admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:09.493710 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-1dbdfb63-81f2-4367-b77b-660d981dd87c admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/ff83be87-679a-4b09-8d3f-add2103f1ac1 HTTP/1.1" status: 204 len: 168 time: 0.1806388 Jun 17 11:15:09.494493 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-5f852d72-cc26-42af-a95c-d82dfbdfde35 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:09.502112 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dbdfb63-81f2-4367-b77b-660d981dd87c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff83be87-679a-4b09-8d3f-add2103f1ac1,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:09.504535 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-1dbdfb63-81f2-4367-b77b-660d981dd87c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:12.035417 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:15:15.263470 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43336) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:15.368855 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6134ae35-7c19-4d56-9aab-2752fa2a75a0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:15.457532 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6134ae35-7c19-4d56-9aab-2752fa2a75a0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:15.536573 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-6134ae35-7c19-4d56-9aab-2752fa2a75a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:15.539207 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9feaaf74-4bca-46c5-ab7b-6ca118c211a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:15.574259 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6134ae35-7c19-4d56-9aab-2752fa2a75a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=539837e2-7784-4bd5-b229-9ab48070a4e7,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:15.579574 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-6134ae35-7c19-4d56-9aab-2752fa2a75a0 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=cc4fa648548b47419edc4df38f6bbff1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3150392 Jun 17 11:15:15.580678 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-6134ae35-7c19-4d56-9aab-2752fa2a75a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:15.582759 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43340) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:15.630536 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-01108861-f889-474b-9825-d35a31513b97 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:15.651831 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-01108861-f889-474b-9825-d35a31513b97 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:15.754017 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-01108861-f889-474b-9825-d35a31513b97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:15.756739 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-01108861-f889-474b-9825-d35a31513b97 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:15.757899 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-01108861-f889-474b-9825-d35a31513b97 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/539837e2-7784-4bd5-b229-9ab48070a4e7 HTTP/1.1" status: 204 len: 168 time: 0.1746514 Jun 17 11:15:15.758807 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-364ea1eb-953f-4ae2-ae4f-b6f49d4e7a0d tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:15.767049 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01108861-f889-474b-9825-d35a31513b97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=539837e2-7784-4bd5-b229-9ab48070a4e7,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:15.769283 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-01108861-f889-474b-9825-d35a31513b97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:16.364953 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43348) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:16.378479 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5fc7c615-9242-4f5d-830e-090da95e0943 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:16.460813 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5fc7c615-9242-4f5d-830e-090da95e0943 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:16.542419 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5fc7c615-9242-4f5d-830e-090da95e0943 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:16.544916 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c425a36d-a966-4f9d-9062-12414fdcef33 tempest-VolumesNegativeTest-278000173 tempest-VolumesNegativeTest-278000173-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:16.578861 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fc7c615-9242-4f5d-830e-090da95e0943 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45111580-e827-4c0e-bedd-c47f5584316b,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:16.583366 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-5fc7c615-9242-4f5d-830e-090da95e0943 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=ece0670bc485451894eee0fab9ccb561&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2173760 Jun 17 11:15:16.584488 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5fc7c615-9242-4f5d-830e-090da95e0943 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:16.586451 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43350) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:16.637709 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-49d862e1-6459-4b2c-b23e-0b127aa9c736 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:16.658352 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-49d862e1-6459-4b2c-b23e-0b127aa9c736 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:16.833810 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-49d862e1-6459-4b2c-b23e-0b127aa9c736 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:16.836650 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-49d862e1-6459-4b2c-b23e-0b127aa9c736 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:16.837671 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-49d862e1-6459-4b2c-b23e-0b127aa9c736 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/45111580-e827-4c0e-bedd-c47f5584316b HTTP/1.1" status: 204 len: 168 time: 0.2502434 Jun 17 11:15:16.838463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-4938ceb7-56e8-4816-aafa-372e514f911c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:16.856373 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d862e1-6459-4b2c-b23e-0b127aa9c736 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=45111580-e827-4c0e-bedd-c47f5584316b,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:16.856373 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-49d862e1-6459-4b2c-b23e-0b127aa9c736 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:19.643235 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43414) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:19.742924 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0f599bab-363f-4398-b474-d9734d0b6a6d admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:19.827384 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0f599bab-363f-4398-b474-d9734d0b6a6d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:19.894463 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0f599bab-363f-4398-b474-d9734d0b6a6d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:19.897840 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-b4efc888-3987-4883-bead-45ee51e0f4aa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:19.931498 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-0f599bab-363f-4398-b474-d9734d0b6a6d admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=e0e03f7b9bba407395edf49e2425b028&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2871904 Jun 17 11:15:19.933521 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f599bab-363f-4398-b474-d9734d0b6a6d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11441c5d-e037-412c-94f9-cddff113c56e,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:19.934179 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43418) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:19.936609 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0f599bab-363f-4398-b474-d9734d0b6a6d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:19.983036 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e09abe49-0365-472c-a108-0fedd275df3c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:20.004550 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e09abe49-0365-472c-a108-0fedd275df3c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:20.159440 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e09abe49-0365-472c-a108-0fedd275df3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:20.162041 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e09abe49-0365-472c-a108-0fedd275df3c admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:20.163332 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-e09abe49-0365-472c-a108-0fedd275df3c admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/11441c5d-e037-412c-94f9-cddff113c56e HTTP/1.1" status: 204 len: 168 time: 0.2279973 Jun 17 11:15:20.164108 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-3c0f7a44-9f6a-40e7-b174-35d31e5cf406 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:20.171751 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e09abe49-0365-472c-a108-0fedd275df3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11441c5d-e037-412c-94f9-cddff113c56e,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:20.177260 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e09abe49-0365-472c-a108-0fedd275df3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:20.713827 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9a9eb106-fe5d-4b3f-8251-62339afb38fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:20.981802 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43424) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:20.995381 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e825be18-8e57-4079-8444-bce88025873c admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:21.084751 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e825be18-8e57-4079-8444-bce88025873c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:21.147832 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-e825be18-8e57-4079-8444-bce88025873c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:21.150323 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c5758b11-e3f4-4a47-867c-9ec4e88f51f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:21.189719 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-e825be18-8e57-4079-8444-bce88025873c admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=89d422a34c4a408eb5809cea437b7ddc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2067351 Jun 17 11:15:21.190520 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e825be18-8e57-4079-8444-bce88025873c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fecd1a19-546a-4081-8dbb-9c35e964c721,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:21.192454 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43426) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:21.193614 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-e825be18-8e57-4079-8444-bce88025873c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:21.242227 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e5b8503a-552c-4696-9dae-ece08c694e66 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:21.264460 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e5b8503a-552c-4696-9dae-ece08c694e66 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:21.371100 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e5b8503a-552c-4696-9dae-ece08c694e66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:21.373692 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-e5b8503a-552c-4696-9dae-ece08c694e66 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:21.374878 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-e5b8503a-552c-4696-9dae-ece08c694e66 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/fecd1a19-546a-4081-8dbb-9c35e964c721 HTTP/1.1" status: 204 len: 168 time: 0.1813219 Jun 17 11:15:21.375704 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-1dbdfb63-81f2-4367-b77b-660d981dd87c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:21.384562 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5b8503a-552c-4696-9dae-ece08c694e66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fecd1a19-546a-4081-8dbb-9c35e964c721,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:21.387077 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-e5b8503a-552c-4696-9dae-ece08c694e66 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:23.331144 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d714f49a-ccd6-466f-829a-2d7dece881f2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:23.576970 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:24.525416 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:26.840590 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:33.796175 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43556) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:33.896905 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:33.982989 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:34.065885 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:34.068377 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-037d1807-e472-4a5f-a73a-0179e1ea5ef8 tempest-AttachVolumeShelveTestJSON-193381486 tempest-AttachVolumeShelveTestJSON-193381486-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:34.103826 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=33796416d10a49a3bff930ff42d71227&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3065922 Jun 17 11:15:34.104719 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3324a392-ec40-4efd-b139-75b4fee6c388,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:34.106433 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43560) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:34.112555 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.112944 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.113341 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.113710 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.114082 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.114450 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.114817 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.115339 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.115709 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.116074 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.116434 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.116795 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110214) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.120749 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-ac50767c-53a3-4eff-ae5b-98cf7517c5de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:34.154638 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:34.176615 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:34.296484 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:34.299634 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:34.300762 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/3324a392-ec40-4efd-b139-75b4fee6c388 HTTP/1.1" status: 204 len: 168 time: 0.1932545 Jun 17 11:15:34.301582 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-1e3a7d6d-ce28-40de-9a29-d62be66cd6cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:34.309111 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3324a392-ec40-4efd-b139-75b4fee6c388,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:34.316748 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.317085 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.317441 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.317931 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.318303 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.318665 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.319058 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.319418 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.319776 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.320132 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.320483 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.320833 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110215) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:15:34.323978 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-ddf7d06e-7ae0-48db-8fb9-4cbb52f00ba6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:34.866960 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43566) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:34.880153 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96508461-7e2e-441e-a1da-3f7817b93951 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:34.963764 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96508461-7e2e-441e-a1da-3f7817b93951 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:35.054212 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-96508461-7e2e-441e-a1da-3f7817b93951 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:35.056743 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-816c8839-e902-43df-9253-559fb703af1a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:35.094810 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-96508461-7e2e-441e-a1da-3f7817b93951 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=54078abfff6c4af988a450a009c98245&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2267704 Jun 17 11:15:35.096296 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96508461-7e2e-441e-a1da-3f7817b93951 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d7e08a3-d591-44cd-8ec7-317b8991f1ce,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:35.098135 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43568) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:35.099829 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-96508461-7e2e-441e-a1da-3f7817b93951 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:35.148792 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d7ea296a-f96d-4c74-a938-544532870d5a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:35.168751 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d7ea296a-f96d-4c74-a938-544532870d5a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:35.296363 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d7ea296a-f96d-4c74-a938-544532870d5a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:35.299085 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d7ea296a-f96d-4c74-a938-544532870d5a admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:35.300292 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-d7ea296a-f96d-4c74-a938-544532870d5a admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/3d7e08a3-d591-44cd-8ec7-317b8991f1ce HTTP/1.1" status: 204 len: 168 time: 0.2011793 Jun 17 11:15:35.301170 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-b69df099-b929-424d-8d73-1f15df565d76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:35.309392 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7ea296a-f96d-4c74-a938-544532870d5a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d7e08a3-d591-44cd-8ec7-317b8991f1ce,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:35.311670 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d7ea296a-f96d-4c74-a938-544532870d5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.011s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:35.993316 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43574) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:36.006666 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-60732837-e1e2-4edf-9f9f-37a29d321cc8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:36.092475 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-60732837-e1e2-4edf-9f9f-37a29d321cc8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:36.210632 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-60732837-e1e2-4edf-9f9f-37a29d321cc8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:36.213157 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-8218956e-924b-4821-925d-61503bd836f5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:36.248700 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-60732837-e1e2-4edf-9f9f-37a29d321cc8 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=988f8d30448b4d4397c9636e94f32201&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2543008 Jun 17 11:15:36.249617 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60732837-e1e2-4edf-9f9f-37a29d321cc8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d12b3da-6d5e-4eb3-ba67-551490ba1d14,revision_number=1']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:36.251369 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43576) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:36.252681 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-60732837-e1e2-4edf-9f9f-37a29d321cc8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:36.301971 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3e927924-4ce1-4443-a859-f23f532350fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:36.325899 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3e927924-4ce1-4443-a859-f23f532350fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:36.485457 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3e927924-4ce1-4443-a859-f23f532350fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:36.488129 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-3e927924-4ce1-4443-a859-f23f532350fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:36.489283 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-3e927924-4ce1-4443-a859-f23f532350fd admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/5d12b3da-6d5e-4eb3-ba67-551490ba1d14 HTTP/1.1" status: 204 len: 168 time: 0.2362700 Jun 17 11:15:36.490059 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8f04958f-e092-4837-ad34-d0243a069672 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:36.497579 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e927924-4ce1-4443-a859-f23f532350fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d12b3da-6d5e-4eb3-ba67-551490ba1d14,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:36.499710 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3e927924-4ce1-4443-a859-f23f532350fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.009s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:37.816673 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:41.767131 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43666) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:41.924889 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Deleting port 3e42ee97-6d6e-45a2-95de-9cb47325e1b1 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:15:41.925139 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:42.001458 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:42.001781 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:42.063732 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Calling delete_port for 3e42ee97-6d6e-45a2-95de-9cb47325e1b1 owned by network:floatingip {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:15:42.300825 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:42.302966 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8ab1a17b-6d7b-4531-bd11-616f0766d677 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:42.328284 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event deleted for resources: {'Port': ['ID=3e42ee97-6d6e-45a2-95de-9cb47325e1b1,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:42.332381 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:42.398167 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:42.398833 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.db.l3_db [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Floating IP 274d0d74-d6f1-48be-a386-56b1f33cbbe1 disassociated (deleted). External IP: 172.27.3.125, port: 770bcd1d-11b2-4b20-b754-72ef4900bdad. Jun 17 11:15:42.608876 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110215) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:15:42.716734 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110215) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:15:42.722794 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:42.726703 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d81ecb99-90d1-435c-9615-807c1063cfd9 None None] Sync routers for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:15:42.736472 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d81ecb99-90d1-435c-9615-807c1063cfd9 None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:15:42.737762 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d81ecb99-90d1-435c-9615-807c1063cfd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:15:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:15:42.758204 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-5fd8a622-af82-4f9b-a24a-4783eebf1916 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "DELETE /v2.0/floatingips/274d0d74-d6f1-48be-a386-56b1f33cbbe1 HTTP/1.1" status: 204 len: 168 time: 0.9899211 Jun 17 11:15:42.758988 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '375d3e67-d829-4a23-be0d-2ba418784148', 'tag': '770bcd1d-11b2-4b20-b754-72ef4900bdad'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:15:42.761362 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd856e91-417a-4822-a716-a4b999b95af6" -d '{"events": [{"name": "network-changed", "server_uuid": "375d3e67-d829-4a23-be0d-2ba418784148", "tag": "770bcd1d-11b2-4b20-b754-72ef4900bdad"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:15:42.851398 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-d81ecb99-90d1-435c-9615-807c1063cfd9 None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:15:42.965331 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:15:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-213809ed-8c30-42ae-aec7-3e427db51d58 x-openstack-request-id: req-213809ed-8c30-42ae-aec7-3e427db51d58 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:15:42.965331 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "375d3e67-d829-4a23-be0d-2ba418784148", "tag": "770bcd1d-11b2-4b20-b754-72ef4900bdad", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:15:42.965331 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-213809ed-8c30-42ae-aec7-3e427db51d58 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:15:42.965331 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '375d3e67-d829-4a23-be0d-2ba418784148', 'tag': '770bcd1d-11b2-4b20-b754-72ef4900bdad', 'status': 'completed', 'code': 200} Jun 17 11:15:43.039052 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd856e91-417a-4822-a716-a4b999b95af6 req-89c3adc1-7599-46ae-9310-fb42b3d95417 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:43.041645 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd856e91-417a-4822-a716-a4b999b95af6 req-89c3adc1-7599-46ae-9310-fb42b3d95417 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 1098 time: 0.0552931 Jun 17 11:15:43.089221 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d81ecb99-90d1-435c-9615-807c1063cfd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'e73e0dd6-cc1b-4554-94ac-70a98e85d0fe', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.216', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:5b:e8:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:42Z', 'updated_at': '2021-06-17T11:10:44Z', 'revision_number': 1, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:15:43.116383 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d81ecb99-90d1-435c-9615-807c1063cfd9 None None] Checking router: 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:15:43.125317 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d81ecb99-90d1-435c-9615-807c1063cfd9 None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:15:43.125870 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d81ecb99-90d1-435c-9615-807c1063cfd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:15:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:15:43.137582 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd856e91-417a-4822-a716-a4b999b95af6 req-5d82e0d0-953a-4f69-aa41-e851b9b382a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:43.139040 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd856e91-417a-4822-a716-a4b999b95af6 req-5d82e0d0-953a-4f69-aa41-e851b9b382a2 service neutron] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 913 time: 0.0912526 Jun 17 11:15:43.181582 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd856e91-417a-4822-a716-a4b999b95af6 req-5d2021f7-43f5-4310-8856-5856315066b8 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=770bcd1d-11b2-4b20-b754-72ef4900bdad HTTP/1.1" status: 200 len: 217 time: 0.0356050 Jun 17 11:15:43.230786 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd856e91-417a-4822-a716-a4b999b95af6 req-03d69cb6-5b72-4a5f-b1d1-d95023f31c53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:43.233242 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd856e91-417a-4822-a716-a4b999b95af6 req-03d69cb6-5b72-4a5f-b1d1-d95023f31c53 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0447094 Jun 17 11:15:43.233971 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-d81ecb99-90d1-435c-9615-807c1063cfd9 None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:15:43.308096 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd856e91-417a-4822-a716-a4b999b95af6 req-3025aefc-ca41-4656-adc9-d75bf742cf86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:43.311503 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd856e91-417a-4822-a716-a4b999b95af6 req-3025aefc-ca41-4656-adc9-d75bf742cf86 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0682786 Jun 17 11:15:43.409049 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd856e91-417a-4822-a716-a4b999b95af6 req-3ccc0cb2-a081-4d86-b472-4da1d46876a0 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897007 Jun 17 11:15:43.491761 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-d81ecb99-90d1-435c-9615-807c1063cfd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'e73e0dd6-cc1b-4554-94ac-70a98e85d0fe', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.216', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:5b:e8:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:42Z', 'updated_at': '2021-06-17T11:10:44Z', 'revision_number': 1, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:15:43.519530 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-cd856e91-417a-4822-a716-a4b999b95af6 req-5e3d6a32-5a2a-4a8c-963f-f592e85009a5 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1036460 Jun 17 11:15:43.567046 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7955d8-3ffe-46cd-997e-cf533fe39c2a req-b2774da4-d8e1-463e-bce8-df73716021ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:43.568662 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0e7955d8-3ffe-46cd-997e-cf533fe39c2a req-b2774da4-d8e1-463e-bce8-df73716021ac tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 945 time: 0.2034302 Jun 17 11:15:43.609298 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-0e7955d8-3ffe-46cd-997e-cf533fe39c2a req-6f773543-ffc6-4451-99e4-32a933def058 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0344746 Jun 17 11:15:43.650115 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d81ecb99-90d1-435c-9615-807c1063cfd9 None None] The sync data for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi is: [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_floatingips': [{'id': 'e73e0dd6-cc1b-4554-94ac-70a98e85d0fe', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'floating_ip_address': '172.27.3.216', 'floating_network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'router_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'port_id': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'mac_address': 'fa:16:3e:5b:e8:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-17T11:10:42Z', 'updated_at': '2021-06-17T11:10:44Z', 'revision_number': 1, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:15:43.880898 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-278c96a4-2f31-4341-9332-ac2ba41e8811 None None] New status for floating IP 274d0d74-d6f1-48be-a386-56b1f33cbbe1: DOWN {{(pid=110218) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:15:44.839191 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-319a2ab2-be6c-4384-8ede-237f9e3d5040 req-c4d0219b-d0cd-4a1d-9475-dc4f808c2f1d tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:44.840641 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-319a2ab2-be6c-4384-8ede-237f9e3d5040 req-c4d0219b-d0cd-4a1d-9475-dc4f808c2f1d tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 945 time: 0.1204214 Jun 17 11:15:44.878737 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-319a2ab2-be6c-4384-8ede-237f9e3d5040 req-47413bf5-191d-43cc-96f8-0b1371173366 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322518 Jun 17 11:15:45.567045 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dff9eb7-12e2-4185-a8b2-f894e26ad6a2 req-b9efe2ff-3597-469a-904c-9a279ac62cd9 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:45.568522 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9dff9eb7-12e2-4185-a8b2-f894e26ad6a2 req-b9efe2ff-3597-469a-904c-9a279ac62cd9 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 945 time: 0.0647855 Jun 17 11:15:45.673992 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-9dff9eb7-12e2-4185-a8b2-f894e26ad6a2 req-893dd6e5-32be-4dee-8f74-601e537f1d8f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Deleting port 770bcd1d-11b2-4b20-b754-72ef4900bdad {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:15:45.674343 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9dff9eb7-12e2-4185-a8b2-f894e26ad6a2 req-893dd6e5-32be-4dee-8f74-601e537f1d8f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:45.767037 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-9dff9eb7-12e2-4185-a8b2-f894e26ad6a2 req-893dd6e5-32be-4dee-8f74-601e537f1d8f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] For port 770bcd1d-11b2-4b20-b754-72ef4900bdad, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=770bcd1d-11b2-4b20-b754-72ef4900bdad,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:15:45.767399 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9dff9eb7-12e2-4185-a8b2-f894e26ad6a2 req-893dd6e5-32be-4dee-8f74-601e537f1d8f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:45.837621 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-9dff9eb7-12e2-4185-a8b2-f894e26ad6a2 req-893dd6e5-32be-4dee-8f74-601e537f1d8f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Calling delete_port for 770bcd1d-11b2-4b20-b754-72ef4900bdad owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:15:45.940992 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-8e3d39fc-c6a3-4e55-99a7-22b98271c1a3 service neutron] 10.222.0.25 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1355023 Jun 17 11:15:46.051874 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-afe3c693-8007-49f7-9b94-bd21b9076d70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:46.053562 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-afe3c693-8007-49f7-9b94-bd21b9076d70 service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 1099 time: 0.0649140 Jun 17 11:15:46.061787 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4baf196-a20d-4721-b954-bf936052f1f5 req-919b958f-b23d-464f-b3d2-3b8c9774ded2 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110214) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:46.063380 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f4baf196-a20d-4721-b954-bf936052f1f5 req-919b958f-b23d-464f-b3d2-3b8c9774ded2 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 945 time: 0.0651262 Jun 17 11:15:46.101923 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-f4baf196-a20d-4721-b954-bf936052f1f5 req-5e8c5e24-e1a4-4e13-9633-e6697df8c605 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319622 Jun 17 11:15:46.107723 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9dff9eb7-12e2-4185-a8b2-f894e26ad6a2 req-893dd6e5-32be-4dee-8f74-601e537f1d8f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:46.113233 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c1557c75-78de-4633-8df2-77eb7ede7eef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:46.163478 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-893dd6e5-32be-4dee-8f74-601e537f1d8f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event deleted for resources: {'Port': ['ID=770bcd1d-11b2-4b20-b754-72ef4900bdad,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:46.169318 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-893dd6e5-32be-4dee-8f74-601e537f1d8f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:46.508179 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-9dff9eb7-12e2-4185-a8b2-f894e26ad6a2 req-893dd6e5-32be-4dee-8f74-601e537f1d8f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] No DVR routers for this DVR port 770bcd1d-11b2-4b20-b754-72ef4900bdad on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:15:46.512192 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-9dff9eb7-12e2-4185-a8b2-f894e26ad6a2 req-893dd6e5-32be-4dee-8f74-601e537f1d8f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:46.514137 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-9dff9eb7-12e2-4185-a8b2-f894e26ad6a2 req-893dd6e5-32be-4dee-8f74-601e537f1d8f tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "DELETE /v2.0/ports/770bcd1d-11b2-4b20-b754-72ef4900bdad HTTP/1.1" status: 204 len: 173 time: 0.9395187 Jun 17 11:15:46.518970 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '375d3e67-d829-4a23-be0d-2ba418784148', 'name': 'network-vif-deleted', 'tag': '770bcd1d-11b2-4b20-b754-72ef4900bdad'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:15:46.518970 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9de3af1c-30b2-4abd-b829-a3149c7eabd6" -d '{"events": [{"server_uuid": "375d3e67-d829-4a23-be0d-2ba418784148", "name": "network-vif-deleted", "tag": "770bcd1d-11b2-4b20-b754-72ef4900bdad"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:15:46.524945 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-ff0c74c3-d2c7-4c63-b264-ebc551ee4481 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:46.526388 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-ff0c74c3-d2c7-4c63-b264-ebc551ee4481 service neutron] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 913 time: 0.4496255 Jun 17 11:15:46.577491 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:15:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2687ebf9-bf72-4e84-8008-56b56465a063 x-openstack-request-id: req-2687ebf9-bf72-4e84-8008-56b56465a063 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:15:46.577491 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "375d3e67-d829-4a23-be0d-2ba418784148", "name": "network-vif-deleted", "tag": "770bcd1d-11b2-4b20-b754-72ef4900bdad", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:15:46.577491 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-2687ebf9-bf72-4e84-8008-56b56465a063 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:15:46.577491 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '375d3e67-d829-4a23-be0d-2ba418784148', 'name': 'network-vif-deleted', 'tag': '770bcd1d-11b2-4b20-b754-72ef4900bdad', 'status': 'completed', 'code': 200} Jun 17 11:15:46.602360 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-60693ce2-5e0c-4323-b913-5913b5029f6a service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=05c3d654-1803-4edd-9ea3-44a8afd65285 HTTP/1.1" status: 200 len: 1002 time: 0.0693684 Jun 17 11:15:46.657062 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-0e303183-704b-49ae-97cf-3632955a769b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:46.658513 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-0e303183-704b-49ae-97cf-3632955a769b service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0496933 Jun 17 11:15:46.718258 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-5c4a31b2-aba3-4dba-88ed-7fb19dab1bcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:46.720249 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-5c4a31b2-aba3-4dba-88ed-7fb19dab1bcf service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0546494 Jun 17 11:15:46.823665 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-9934d5df-6971-4cce-8996-81b1eb0e3bf0 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846794 Jun 17 11:15:46.917441 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-1443eb99-54dc-4728-a1ce-37ede26249cd req-e227faf9-82e0-4ad4-8ba8-799170a310f1 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862336 Jun 17 11:15:47.260811 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-42939728-c3f7-4de1-a42e-a1a56386f44c req-2eaa2a7c-0199-42b1-a108-ba828bc66d03 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=375d3e67-d829-4a23-be0d-2ba418784148 HTTP/1.1" status: 200 len: 210 time: 0.0284235 Jun 17 11:15:48.335201 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 770bcd1d-11b2-4b20-b754-72ef4900bdad no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:15:48.355217 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 770bcd1d-11b2-4b20-b754-72ef4900bdad {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:15:48.355694 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 770bcd1d-11b2-4b20-b754-72ef4900bdad not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:15:49.034574 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:15:50.682885 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-6e4f701e-43de-4924-8cf0-b1af4b245d37 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:50.804899 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43734) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:50.954557 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Deleting port 07f72c25-2af1-4a82-b942-13ecd003a41d {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:15:50.954795 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:51.029125 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:51.029448 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:51.092248 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Calling delete_port for 07f72c25-2af1-4a82-b942-13ecd003a41d owned by network:floatingip {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:15:51.336281 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:51.338364 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d0ca6db8-b6ce-4d6d-b392-f98ad2e209da admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:51.363714 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event deleted for resources: {'Port': ['ID=07f72c25-2af1-4a82-b942-13ecd003a41d,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:51.367190 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:51.425945 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:51.426272 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.db.l3_db [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Floating IP e73e0dd6-cc1b-4554-94ac-70a98e85d0fe disassociated (deleted). External IP: 172.27.3.216, port: 05c3d654-1803-4edd-9ea3-44a8afd65285. Jun 17 11:15:51.633242 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:15:51.989597 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:15:51.994174 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:51.998744 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bc3f5d7-27ab-4ea8-8e10-605e093f16de None None] Sync routers for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:15:52.008489 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bc3f5d7-27ab-4ea8-8e10-605e093f16de None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:15:52.009110 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5bc3f5d7-27ab-4ea8-8e10-605e093f16de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:15:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:15:52.028862 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-0b3a5ea7-76b7-4f12-990b-b5be28d744fe tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "DELETE /v2.0/floatingips/e73e0dd6-cc1b-4554-94ac-70a98e85d0fe HTTP/1.1" status: 204 len: 168 time: 1.2228076 Jun 17 11:15:52.029634 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'tag': '05c3d654-1803-4edd-9ea3-44a8afd65285'}] {{(pid=110214) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:15:52.032091 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cc2cf72888dbbd14a3b8c118b05d43e907687f619eecab2abc2da29781eba8b9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-529376c6-c4b2-4bf2-8261-a26485551a5a" -d '{"events": [{"name": "network-changed", "server_uuid": "ea22557b-cbc7-47a3-9ae1-915b71aefe0b", "tag": "05c3d654-1803-4edd-9ea3-44a8afd65285"}]}' {{(pid=110214) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:15:52.116433 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-5bc3f5d7-27ab-4ea8-8e10-605e093f16de None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:15:52.124031 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 17 Jun 2021 11:15:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ee57a14e-e3eb-4cec-b436-529e2e4d04c1 x-openstack-request-id: req-ee57a14e-e3eb-4cec-b436-529e2e4d04c1 {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:15:52.124575 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ea22557b-cbc7-47a3-9ae1-915b71aefe0b", "tag": "05c3d654-1803-4edd-9ea3-44a8afd65285", "status": "completed", "code": 200}]} {{(pid=110214) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:15:52.124931 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-ee57a14e-e3eb-4cec-b436-529e2e4d04c1 {{(pid=110214) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:15:52.126024 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'tag': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'status': 'completed', 'code': 200} Jun 17 11:15:52.200892 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529376c6-c4b2-4bf2-8261-a26485551a5a req-23fac3d2-7e2b-41e0-b806-d14c6297557a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:52.202361 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-529376c6-c4b2-4bf2-8261-a26485551a5a req-23fac3d2-7e2b-41e0-b806-d14c6297557a service neutron] 10.222.0.25 "GET /v2.0/ports?tenant_id=a7706f138ac3465ba5820edf148d8153&device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 1099 time: 0.0522757 Jun 17 11:15:52.295985 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529376c6-c4b2-4bf2-8261-a26485551a5a req-c0ea2699-6116-4541-889e-1f53182ae2bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:52.297597 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-529376c6-c4b2-4bf2-8261-a26485551a5a req-c0ea2699-6116-4541-889e-1f53182ae2bd service neutron] 10.222.0.25 "GET /v2.0/networks?id=79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 200 len: 913 time: 0.0881245 Jun 17 11:15:52.329901 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5bc3f5d7-27ab-4ea8-8e10-605e093f16de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:15:52.339968 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-529376c6-c4b2-4bf2-8261-a26485551a5a req-a2f9800b-67a8-48f4-b235-dc129d1d9667 service neutron] 10.222.0.25 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=05c3d654-1803-4edd-9ea3-44a8afd65285 HTTP/1.1" status: 200 len: 217 time: 0.0345752 Jun 17 11:15:52.356749 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bc3f5d7-27ab-4ea8-8e10-605e093f16de None None] Checking router: 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:15:52.365715 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bc3f5d7-27ab-4ea8-8e10-605e093f16de None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:15:52.366350 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5bc3f5d7-27ab-4ea8-8e10-605e093f16de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:15:23Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:15:52.389333 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529376c6-c4b2-4bf2-8261-a26485551a5a req-edbbe0d2-0905-4a1b-b003-ba19aab32b79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:52.391138 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-529376c6-c4b2-4bf2-8261-a26485551a5a req-edbbe0d2-0905-4a1b-b003-ba19aab32b79 service neutron] 10.222.0.25 "GET /v2.0/subnets?id=1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 200 len: 851 time: 0.0436339 Jun 17 11:15:52.459880 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529376c6-c4b2-4bf2-8261-a26485551a5a req-208d8586-eae1-485c-aff1-0684cf670df0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:52.461325 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-529376c6-c4b2-4bf2-8261-a26485551a5a req-208d8586-eae1-485c-aff1-0684cf670df0 service neutron] 10.222.0.25 "GET /v2.0/ports?network_id=79f5bf09-f965-46d9-8615-13aab136e8eb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0565116 Jun 17 11:15:52.475964 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-5bc3f5d7-27ab-4ea8-8e10-605e093f16de None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:15:52.557366 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-529376c6-c4b2-4bf2-8261-a26485551a5a req-c680c0e2-5d9f-409c-960a-d567d6befef8 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879297 Jun 17 11:15:52.677524 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-5bc3f5d7-27ab-4ea8-8e10-605e093f16de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:15:52.696661 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-529376c6-c4b2-4bf2-8261-a26485551a5a req-0d98de4e-a775-4df6-b4de-e7b4b4038395 service neutron] 10.222.0.25 "GET /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1305850 Jun 17 11:15:52.704923 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5bdfb40-7b19-4e2f-a9cb-d8ef67a40347 req-deb2f49c-199b-4e22-be6c-eb0ce5195297 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:52.706963 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c5bdfb40-7b19-4e2f-a9cb-d8ef67a40347 req-deb2f49c-199b-4e22-be6c-eb0ce5195297 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 946 time: 0.1331685 Jun 17 11:15:52.708683 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bc3f5d7-27ab-4ea8-8e10-605e093f16de None None] The sync data for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi is: [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:06:28Z', 'revision_number': 4, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi', '_interfaces': [{'id': '8a8a48c5-e1b7-4c6e-84a1-5f693db6e663', 'name': '', 'network_id': '79f5bf09-f965-46d9-8615-13aab136e8eb', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'mac_address': 'fa:16:3e:39:95:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '1df800fd-de2b-4d27-b603-4af981229332', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:27Z', 'updated_at': '2021-06-17T11:06:32Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'subnets': [{'id': '1df800fd-de2b-4d27-b603-4af981229332', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:15:52.747536 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-c5bdfb40-7b19-4e2f-a9cb-d8ef67a40347 req-4d4c383e-6d4c-49fe-bb6d-778c7cd9b8dd tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/security-groups?id=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0334406 Jun 17 11:15:52.926340 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a9c2bc6-7180-4d2f-9308-c6a6ef57de62 None None] New status for floating IP e73e0dd6-cc1b-4554-94ac-70a98e85d0fe: DOWN {{(pid=110218) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Jun 17 11:15:53.383586 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba0ba27b-a77b-473f-968a-6dc8e28a2e1d req-e1f24592-4efc-40c2-a0eb-827f1c8bb274 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=110215) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Jun 17 11:15:53.385007 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba0ba27b-a77b-473f-968a-6dc8e28a2e1d req-e1f24592-4efc-40c2-a0eb-827f1c8bb274 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 946 time: 0.0654492 Jun 17 11:15:53.393361 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-d84151a4-75bb-42b0-9500-dc07f377bfa6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:53.482605 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-ba0ba27b-a77b-473f-968a-6dc8e28a2e1d req-af2fec7f-134b-4892-928c-801484f5a284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Deleting port 05c3d654-1803-4edd-9ea3-44a8afd65285 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:15:53.482989 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-ba0ba27b-a77b-473f-968a-6dc8e28a2e1d req-af2fec7f-134b-4892-928c-801484f5a284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:53.574424 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [req-ba0ba27b-a77b-473f-968a-6dc8e28a2e1d req-af2fec7f-134b-4892-928c-801484f5a284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] For port 05c3d654-1803-4edd-9ea3-44a8afd65285, host hv-cinder-77387, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77387',level=0,port_id=05c3d654-1803-4edd-9ea3-44a8afd65285,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:15:53.574779 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-ba0ba27b-a77b-473f-968a-6dc8e28a2e1d req-af2fec7f-134b-4892-928c-801484f5a284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:53.576044 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:53.637490 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [req-ba0ba27b-a77b-473f-968a-6dc8e28a2e1d req-af2fec7f-134b-4892-928c-801484f5a284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Calling delete_port for 05c3d654-1803-4edd-9ea3-44a8afd65285 owned by compute:nova {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:15:53.827218 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-ba0ba27b-a77b-473f-968a-6dc8e28a2e1d req-af2fec7f-134b-4892-928c-801484f5a284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:53.831928 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c9e8d5c9-0e2f-4236-91d8-47e8f4bc06de service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:53.856826 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2fec7f-134b-4892-928c-801484f5a284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event deleted for resources: {'Port': ['ID=05c3d654-1803-4edd-9ea3-44a8afd65285,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:53.859892 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-af2fec7f-134b-4892-928c-801484f5a284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:53.894703 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-ca295b5e-94c1-414e-ae3a-4771ffda8dad req-c7ce1a54-a41c-4ab3-a171-57fe44935509 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 210 time: 0.0337400 Jun 17 11:15:53.906067 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [req-ba0ba27b-a77b-473f-968a-6dc8e28a2e1d req-af2fec7f-134b-4892-928c-801484f5a284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] No DVR routers for this DVR port 05c3d654-1803-4edd-9ea3-44a8afd65285 on host hv-cinder-77387 {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:15:53.908702 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [req-ba0ba27b-a77b-473f-968a-6dc8e28a2e1d req-af2fec7f-134b-4892-928c-801484f5a284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for port, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:53.910696 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [req-ba0ba27b-a77b-473f-968a-6dc8e28a2e1d req-af2fec7f-134b-4892-928c-801484f5a284 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.25 "DELETE /v2.0/ports/05c3d654-1803-4edd-9ea3-44a8afd65285 HTTP/1.1" status: 204 len: 173 time: 0.5197518 Jun 17 11:15:53.911283 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'name': 'network-vif-deleted', 'tag': '05c3d654-1803-4edd-9ea3-44a8afd65285'}] {{(pid=110215) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Jun 17 11:15:53.913572 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.41/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e8922d276276d2ce6111eb528dd82e7700192e5fa9371f23b58b9406438967f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d7df164c-0d14-4cb6-8b31-49c2f1256d67" -d '{"events": [{"server_uuid": "ea22557b-cbc7-47a3-9ae1-915b71aefe0b", "name": "network-vif-deleted", "tag": "05c3d654-1803-4edd-9ea3-44a8afd65285"}]}' {{(pid=110215) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Jun 17 11:15:53.947882 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 17 Jun 2021 11:15:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1029d917-ac69-4f7a-9ee5-7e9061d30550 x-openstack-request-id: req-1029d917-ac69-4f7a-9ee5-7e9061d30550 {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Jun 17 11:15:53.948211 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ea22557b-cbc7-47a3-9ae1-915b71aefe0b", "name": "network-vif-deleted", "tag": "05c3d654-1803-4edd-9ea3-44a8afd65285", "status": "completed", "code": 200}]} {{(pid=110215) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Jun 17 11:15:53.948500 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.41/compute/v2.1/os-server-external-events used request id req-1029d917-ac69-4f7a-9ee5-7e9061d30550 {{(pid=110215) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Jun 17 11:15:53.948933 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ea22557b-cbc7-47a3-9ae1-915b71aefe0b', 'name': 'network-vif-deleted', 'tag': '05c3d654-1803-4edd-9ea3-44a8afd65285', 'status': 'completed', 'code': 200} Jun 17 11:15:54.553243 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:55.051545 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [req-e3f179ef-4e60-4625-92c1-497e62ef3632 req-15afbe9b-bfce-4cda-9a91-3b5b9333aa6c tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "GET /v2.0/ports?device_id=ea22557b-cbc7-47a3-9ae1-915b71aefe0b HTTP/1.1" status: 200 len: 210 time: 0.0284765 Jun 17 11:15:56.142223 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43772) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:56.266693 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Deleting port db671183-dbc1-4efc-86f5-c3892b598ff7 {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:15:56.267068 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:56.342162 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:56.342496 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:56.399575 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 05c3d654-1803-4edd-9ea3-44a8afd65285 no longer exists at agent hyperv_hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:15:56.414357 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Calling delete_port for db671183-dbc1-4efc-86f5-c3892b598ff7 owned by network:floatingip {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:15:56.420566 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] No Port match for: 05c3d654-1803-4edd-9ea3-44a8afd65285 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:15:56.420919 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Device 05c3d654-1803-4edd-9ea3-44a8afd65285 not bound to the agent host hv-cinder-77387 {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:15:56.621722 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:56.623755 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:56.649235 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event deleted for resources: {'Port': ['ID=db671183-dbc1-4efc-86f5-c3892b598ff7,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:56.652950 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:56.708993 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for floatingip, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:56.711584 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-123813'] for floatingip, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:56.714140 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "DELETE /v2.0/floatingips/277ae957-e21c-497c-8ffe-d40d1c6418e5 HTTP/1.1" status: 204 len: 168 time: 0.5693462 Jun 17 11:15:56.844558 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:58.140904 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43798) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:58.198364 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-86342d51-af9e-4fdc-8d4c-0d54125e2b6b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:58.221721 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-86342d51-af9e-4fdc-8d4c-0d54125e2b6b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:58.392731 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-86342d51-af9e-4fdc-8d4c-0d54125e2b6b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:58.395610 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-86342d51-af9e-4fdc-8d4c-0d54125e2b6b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:58.396803 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-86342d51-af9e-4fdc-8d4c-0d54125e2b6b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] 10.222.0.41 "DELETE /v2.0/security-groups/3b3dcbc2-41c2-439d-a885-9ba22ead5a7e HTTP/1.1" status: 204 len: 168 time: 0.2549028 Jun 17 11:15:58.397762 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-3e927924-4ce1-4443-a859-f23f532350fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:58.407048 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86342d51-af9e-4fdc-8d4c-0d54125e2b6b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b3dcbc2-41c2-439d-a885-9ba22ead5a7e,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:58.410657 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-86342d51-af9e-4fdc-8d4c-0d54125e2b6b tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:58.538453 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43806) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:15:58.978944 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8355326'] for router_interface, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:59.221943 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] Deleting port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:15:59.222287 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:59.298541 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] For port 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=8a8a48c5-e1b7-4c6e-84a1-5f693db6e663,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:15:59.298864 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:59.364612 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] Calling delete_port for 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 owned by network:router_interface {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:15:59.655693 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:15:59.657884 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f277a941-71ec-45d5-8a12-ec6202b79113 tempest-TestVolumeBootPattern-137919540 tempest-TestVolumeBootPattern-137919540-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:15:59.681754 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] Pushing event deleted for resources: {'Port': ['ID=8a8a48c5-e1b7-4c6e-84a1-5f693db6e663,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:15:59.684928 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:15:59.848981 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7899567', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8355178'] for router_interface, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:00.053436 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] Router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:16:00.154284 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:16:00.159729 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-dfb6ed3e-d665-4e4b-8971-468ef6f68f4b admin admin] 10.222.0.41 "PUT /v2.0/routers/1bb918b0-c975-4f28-83d6-0f8096dc1ea8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6194561 Jun 17 11:16:00.162267 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43812) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:00.163100 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-838693b9-803d-4568-b15d-c322872abfb2 None None] Sync routers for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:16:00.172413 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-838693b9-803d-4568-b15d-c322872abfb2 None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:16:00.173051 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-838693b9-803d-4568-b15d-c322872abfb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:15:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:00.266998 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Notify callbacks [] for router, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:00.278570 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-838693b9-803d-4568-b15d-c322872abfb2 None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:16:00.367555 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:00.462616 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-838693b9-803d-4568-b15d-c322872abfb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191'}], 'enable_snat': True}, 'gw_port_id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:15:59Z', 'revision_number': 5, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port': {'id': '80ef5e0e-ad92-467c-b96f-d42eb1a349e4', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:07:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 559, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:25Z', 'updated_at': '2021-06-17T11:06:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:00.492679 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-838693b9-803d-4568-b15d-c322872abfb2 None None] Checking router: 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 for host: dv-cinder-773870-6-iscsi {{(pid=110216) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:16:00.501100 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-838693b9-803d-4568-b15d-c322872abfb2 None None] Routers {'1bb918b0-c975-4f28-83d6-0f8096dc1ea8'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110216) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:16:00.501767 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-838693b9-803d-4568-b15d-c322872abfb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:15:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'], 'active': True} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:00.510235 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Deleting port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:16:00.510569 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:00.603166 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvr_db [None req-838693b9-803d-4568-b15d-c322872abfb2 None None] Set router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 gateway port host: None {{(pid=110216) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:16:00.603572 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] For port 80ef5e0e-ad92-467c-b96f-d42eb1a349e4, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=80ef5e0e-ad92-467c-b96f-d42eb1a349e4,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:16:00.603939 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:00.655740 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_hamode_db [None req-838693b9-803d-4568-b15d-c322872abfb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:16:00Z', 'revision_number': 6, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port_host': None}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:00.675080 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Calling delete_port for 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 owned by network:router_gateway {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:16:00.685015 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-838693b9-803d-4568-b15d-c322872abfb2 None None] The sync data for ids ['1bb918b0-c975-4f28-83d6-0f8096dc1ea8'] in dv-cinder-773870-6-iscsi is: [{'id': '1bb918b0-c975-4f28-83d6-0f8096dc1ea8', 'name': 'tempest-TestVolumeBootPattern-1135349585-router', 'tenant_id': 'a7706f138ac3465ba5820edf148d8153', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:24Z', 'updated_at': '2021-06-17T11:16:00Z', 'revision_number': 6, 'project_id': 'a7706f138ac3465ba5820edf148d8153', 'gw_port_host': None}] {{(pid=110216) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:16:00.912543 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:00.914681 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f59d1ba5-6eb4-427f-aac9-ab8ade669f3a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:00.939541 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Pushing event deleted for resources: {'Port': ['ID=80ef5e0e-ad92-467c-b96f-d42eb1a349e4,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:00.943761 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:01.000860 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8286505'] for router_gateway, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.089280 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8357994', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2026'] for router, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.091582 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.209778 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8291427'] for router, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.210253 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1bb918b0-c975-4f28-83d6-0f8096dc1ea8 {{(pid=110214) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Jun 17 11:16:01.215285 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] Notify callbacks [] for router, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.216302 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-06094a7b-772b-46cc-a825-070e7fa0029a admin admin] 10.222.0.41 "DELETE /v2.0/routers/1bb918b0-c975-4f28-83d6-0f8096dc1ea8 HTTP/1.1" status: 204 len: 168 time: 1.0530457 Jun 17 11:16:01.218659 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43816) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:01.262664 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_v2 [None req-d46aa666-dbff-4751-9f40-9e2b5dbeb796 admin admin] Deleting subnet 1df800fd-de2b-4d27-b603-4af981229332 {{(pid=110214) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:16:01.265621 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d46aa666-dbff-4751-9f40-9e2b5dbeb796 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.303345 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d46aa666-dbff-4751-9f40-9e2b5dbeb796 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6228443'] for subnet, precommit_delete_associations {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.412354 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d46aa666-dbff-4751-9f40-9e2b5dbeb796 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.541701 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d46aa666-dbff-4751-9f40-9e2b5dbeb796 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6239301', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5530029'] for subnet, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.544278 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-c70325e8-50d4-479b-87ee-d6f07da610e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:01.566808 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d46aa666-dbff-4751-9f40-9e2b5dbeb796 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1df800fd-de2b-4d27-b603-4af981229332,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:01.570664 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d46aa666-dbff-4751-9f40-9e2b5dbeb796 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:01.573714 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-d46aa666-dbff-4751-9f40-9e2b5dbeb796 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.575685 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-d46aa666-dbff-4751-9f40-9e2b5dbeb796 admin admin] 10.222.0.41 "DELETE /v2.0/subnets/1df800fd-de2b-4d27-b603-4af981229332 HTTP/1.1" status: 204 len: 168 time: 0.3559828 Jun 17 11:16:01.580104 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43818) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:01.582599 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c816339-8d78-46c7-9252-a7a3171d3037 None None] Network 79f5bf09-f965-46d9-8615-13aab136e8eb requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:16:01.659970 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.726203 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Deleting port d757c630-7d66-4580-bba7-39491a2b41f2 {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:16:01.726541 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.793605 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] For port d757c630-7d66-4580-bba7-39491a2b41f2, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=d757c630-7d66-4580-bba7-39491a2b41f2,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:16:01.793881 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:01.860343 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Calling delete_port for d757c630-7d66-4580-bba7-39491a2b41f2 owned by network:dhcp {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:16:01.927445 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] DHCP port deletion for 79f5bf09-f965-46d9-8615-13aab136e8eb request from dv-cinder-773870-6-iscsi {{(pid=110216) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Jun 17 11:16:01.973329 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Deleting port d757c630-7d66-4580-bba7-39491a2b41f2 {{(pid=110216) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:16:01.973633 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:02.016092 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:02.018949 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c4815732-a115-419e-b787-c2581ab47757 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:02.035829 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] For port d757c630-7d66-4580-bba7-39491a2b41f2, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=d757c630-7d66-4580-bba7-39491a2b41f2,segment=NetworkSegment(4b17136b-e614-458c-90d5-3642ab6ac536),segment_id=4b17136b-e614-458c-90d5-3642ab6ac536)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:16:02.036235 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:02.045713 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Pushing event deleted for resources: {'Port': ['ID=d757c630-7d66-4580-bba7-39491a2b41f2,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:02.049101 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:02.049892 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] No DVR routers for this DVR port d757c630-7d66-4580-bba7-39491a2b41f2 on host dv-cinder-773870-6-iscsi {{(pid=110215) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:16:02.105444 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Calling delete_port for d757c630-7d66-4580-bba7-39491a2b41f2 owned by network:dhcp {{(pid=110216) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:16:02.120273 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:02.130670 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['79f5bf09-f965-46d9-8615-13aab136e8eb']}} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:02.140590 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4b17136b-e614-458c-90d5-3642ab6ac536') {'for_net_delete': True} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:02.140890 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.services.segments.db [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4b17136b-e614-458c-90d5-3642ab6ac536') {} {{(pid=110215) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:02.149691 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6032818'] for segment, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:02.167542 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:02.173587 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Releasing vlan 135 on physical network physnet1 to pool {{(pid=110215) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:16:02.174549 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5898799'] for segment, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: Traceback (most recent call last): Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: timer() Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: cb(*args, **kw) Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: return func(*args, **kwargs) Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: self._notify() Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: self.callback(batched_events) Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: event.method(event) Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: return f(self, *a, **k) Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._get(url).json() Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: return self.request(url, 'GET', **kwargs) Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:16:02.176236 dv-cinder-773870-6-iscsi neutron-server[110215]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:16:02.183854 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159'] for port, after_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:02.185749 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:02.213792 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Pushing event deleted for resources: {'Port': ['ID=d757c630-7d66-4580-bba7-39491a2b41f2,revision_number=None']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:02.218809 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] No DVR routers for this DVR port d757c630-7d66-4580-bba7-39491a2b41f2 on host dv-cinder-773870-6-iscsi {{(pid=110216) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:16:02.226013 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.226459 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.226750 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.227086 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.227420 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.227744 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.228072 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.228427 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.228754 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.229070 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.229393 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.229707 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773870-6-iscsi {{(pid=110216) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Jun 17 11:16:02.232580 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-0fd045b2-6d72-446a-b9bd-54bc2b61842f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:02.293933 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:02.297997 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-fb5d6175-9bb5-42fc-8580-e78a7a8848d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:02.303336 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:02.303336 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] 10.222.0.41 "DELETE /v2.0/networks/79f5bf09-f965-46d9-8615-13aab136e8eb HTTP/1.1" status: 204 len: 168 time: 0.7239354 Jun 17 11:16:02.306076 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43822) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:02.313859 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Pushing event deleted for resources: {'Network': ['ID=79f5bf09-f965-46d9-8615-13aab136e8eb,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:02.319456 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-0b64a72e-da33-480b-ae53-9b8d73c5a9e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:02.457091 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:16:02.478426 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:16:02.478775 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 8a8a48c5-e1b7-4c6e-84a1-5f693db6e663 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:16:02.479241 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:16:02.499294 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:16:02.499567 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 80ef5e0e-ad92-467c-b96f-d42eb1a349e4 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:16:02.500000 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d757c630-7d66-4580-bba7-39491a2b41f2 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:16:02.520407 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: d757c630-7d66-4580-bba7-39491a2b41f2 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:16:02.520754 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d757c630-7d66-4580-bba7-39491a2b41f2 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:16:02.919477 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-8355326'] for router_interface, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:03.174831 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] Deleting port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:16:03.175232 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:03.258100 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] For port 3ccaf261-8495-4cce-b1fe-0a21cafe2da6, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=3ccaf261-8495-4cce-b1fe-0a21cafe2da6,segment=NetworkSegment(6da795d9-bcc2-4d51-a172-5202131b57f9),segment_id=6da795d9-bcc2-4d51-a172-5202131b57f9)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:16:03.258374 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:03.327692 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] Calling delete_port for 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 owned by network:router_interface {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:16:03.825452 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:03.828443 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-798ac3b3-8229-4fde-8cbf-f42697985322 tempest-TestMinimumBasicScenario-2139200817 tempest-TestMinimumBasicScenario-2139200817-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:03.854321 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] Pushing event deleted for resources: {'Port': ['ID=3ccaf261-8495-4cce-b1fe-0a21cafe2da6,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:03.859518 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:04.030080 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7899567', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-8355178'] for router_interface, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:04.234932 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] Router 20449287-f8f8-4a50-bd14-05062b12f3f6 has already been hosted by L3 agent 0fb51072-15c5-4edb-88a8-9c1800106c24 {{(pid=110214) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} Jun 17 11:16:04.343733 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] Notify agent at l3_agent.dv-cinder-773870-6-iscsi the message routers_updated {{(pid=110214) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} Jun 17 11:16:04.348860 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-693798db-2f91-43cb-86c1-0f8873456c2a admin admin] 10.222.0.41 "PUT /v2.0/routers/20449287-f8f8-4a50-bd14-05062b12f3f6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0412855 Jun 17 11:16:04.351524 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43832) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:04.352020 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-709deb35-5bd0-40e2-9018-7c02c8ec9fad None None] Sync routers for ids ['20449287-f8f8-4a50-bd14-05062b12f3f6'] in dv-cinder-773870-6-iscsi {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Jun 17 11:16:04.361212 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-709deb35-5bd0-40e2-9018-7c02c8ec9fad None None] Routers {'20449287-f8f8-4a50-bd14-05062b12f3f6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:16:04.361829 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-709deb35-5bd0-40e2-9018-7c02c8ec9fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:15:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20449287-f8f8-4a50-bd14-05062b12f3f6'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:04.465168 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Notify callbacks [] for router, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:04.468952 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-709deb35-5bd0-40e2-9018-7c02c8ec9fad None None] Set router 20449287-f8f8-4a50-bd14-05062b12f3f6 gateway port host: dv-cinder-773870-6-iscsi {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:16:04.569202 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:04.649308 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-709deb35-5bd0-40e2-9018-7c02c8ec9fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'name': 'tempest-TestVolumeBootPattern-1639554808-router', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'external_fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210'}], 'enable_snat': True}, 'gw_port_id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:16:03Z', 'revision_number': 5, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'gw_port': {'id': 'e10e5a3c-f4c9-447f-a41d-92fddeec496d', 'name': '', 'network_id': 'ae4da6f8-a7ac-4884-8d49-a1c679d58f18', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:82:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'ip_address': '172.27.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773870-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f8350199-265a-4724-9d19-42e5cbbe0f87', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773870-6-iscsi'}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:04.675663 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-709deb35-5bd0-40e2-9018-7c02c8ec9fad None None] Checking router: 20449287-f8f8-4a50-bd14-05062b12f3f6 for host: dv-cinder-773870-6-iscsi {{(pid=110218) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Jun 17 11:16:04.685153 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvrscheduler_db [None req-709deb35-5bd0-40e2-9018-7c02c8ec9fad None None] Routers {'20449287-f8f8-4a50-bd14-05062b12f3f6'} bound to L3 agent in host dv-cinder-773870-6-iscsi {{(pid=110218) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} Jun 17 11:16:04.686392 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-709deb35-5bd0-40e2-9018-7c02c8ec9fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773870-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-17T10:51:23Z,description=,heartbeat_timestamp=2021-06-17T11:15:53Z,host='dv-cinder-773870-6-iscsi',id=0fb51072-15c5-4edb-88a8-9c1800106c24,load=0,resource_versions=,resources_synced=,started_at=2021-06-17T10:51:24Z,topic='l3_agent')) {'router_ids': ['20449287-f8f8-4a50-bd14-05062b12f3f6'], 'active': True} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:04.694783 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Deleting port e10e5a3c-f4c9-447f-a41d-92fddeec496d {{(pid=110215) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:16:04.695356 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:04.812299 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_dvr_db [None req-709deb35-5bd0-40e2-9018-7c02c8ec9fad None None] Set router 20449287-f8f8-4a50-bd14-05062b12f3f6 gateway port host: None {{(pid=110218) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:841}} Jun 17 11:16:04.812898 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.db [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] For port e10e5a3c-f4c9-447f-a41d-92fddeec496d, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=e10e5a3c-f4c9-447f-a41d-92fddeec496d,segment=NetworkSegment(402f72d8-702e-43eb-a72d-76f851a64294),segment_id=402f72d8-702e-43eb-a72d-76f851a64294)] {{(pid=110215) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:16:04.813248 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:04.862573 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.l3_hamode_db [None req-709deb35-5bd0-40e2-9018-7c02c8ec9fad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'name': 'tempest-TestVolumeBootPattern-1639554808-router', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:16:04Z', 'revision_number': 6, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'gw_port_host': None}], 'dv-cinder-773870-6-iscsi', False) {} {{(pid=110218) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:04.875960 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.plugins.ml2.plugin [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Calling delete_port for e10e5a3c-f4c9-447f-a41d-92fddeec496d owned by network:router_gateway {{(pid=110215) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:16:04.891607 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-709deb35-5bd0-40e2-9018-7c02c8ec9fad None None] The sync data for ids ['20449287-f8f8-4a50-bd14-05062b12f3f6'] in dv-cinder-773870-6-iscsi is: [{'id': '20449287-f8f8-4a50-bd14-05062b12f3f6', 'name': 'tempest-TestVolumeBootPattern-1639554808-router', 'tenant_id': '1d11d9badea6421585a99e4199bc739c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-17T11:06:32Z', 'updated_at': '2021-06-17T11:16:04Z', 'revision_number': 6, 'project_id': '1d11d9badea6421585a99e4199bc739c', 'gw_port_host': None}] {{(pid=110218) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Jun 17 11:16:05.105516 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5898872'] for port, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.107635 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-bb7a7fc0-b8bf-41c3-be66-013596681a32 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:05.134805 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Pushing event deleted for resources: {'Port': ['ID=e10e5a3c-f4c9-447f-a41d-92fddeec496d,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:05.138192 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:05.197556 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-8286505'] for router_gateway, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.286268 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-8357994', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2026'] for router, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.288707 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.412301 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-8291427'] for router, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.413002 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 20449287-f8f8-4a50-bd14-05062b12f3f6 {{(pid=110215) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} Jun 17 11:16:05.418337 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] Notify callbacks [] for router, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.419764 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-048c00de-8545-49e3-b227-1c92d19f6689 admin admin] 10.222.0.41 "DELETE /v2.0/routers/20449287-f8f8-4a50-bd14-05062b12f3f6 HTTP/1.1" status: 204 len: 168 time: 1.0669956 Jun 17 11:16:05.422174 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43836) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:05.467992 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.db_base_plugin_v2 [None req-19f6a5fb-1d9d-4f68-8e5a-b57d97a83da8 admin admin] Deleting subnet 0d3143a1-382a-4be3-8a4e-ee1df88a5463 {{(pid=110214) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Jun 17 11:16:05.472006 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-19f6a5fb-1d9d-4f68-8e5a-b57d97a83da8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.507049 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-19f6a5fb-1d9d-4f68-8e5a-b57d97a83da8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6228443'] for subnet, precommit_delete_associations {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.592480 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-19f6a5fb-1d9d-4f68-8e5a-b57d97a83da8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-968982'] for subnet, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.736310 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-19f6a5fb-1d9d-4f68-8e5a-b57d97a83da8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-968991', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25175', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6239301', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5530029'] for subnet, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.738717 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:05.762717 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19f6a5fb-1d9d-4f68-8e5a-b57d97a83da8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0d3143a1-382a-4be3-8a4e-ee1df88a5463,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:05.765776 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-19f6a5fb-1d9d-4f68-8e5a-b57d97a83da8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:05.766769 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-19f6a5fb-1d9d-4f68-8e5a-b57d97a83da8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for subnet, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.769179 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-19f6a5fb-1d9d-4f68-8e5a-b57d97a83da8 admin admin] 10.222.0.41 "DELETE /v2.0/subnets/0d3143a1-382a-4be3-8a4e-ee1df88a5463 HTTP/1.1" status: 204 len: 168 time: 0.3460317 Jun 17 11:16:05.771722 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43840) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:05.774275 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de123ae0-f13a-4ef8-b0b2-fb8f53f57533 None None] Network 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df requested from dv-cinder-773870-6-iscsi {{(pid=110216) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Jun 17 11:16:05.844536 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-617108'] for network, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.900913 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Deleting port d642d88d-f459-4c3f-82a1-35a0cdc09cee {{(pid=110214) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:16:05.901383 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.964341 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.db [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] For port d642d88d-f459-4c3f-82a1-35a0cdc09cee, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=d642d88d-f459-4c3f-82a1-35a0cdc09cee,segment=NetworkSegment(6da795d9-bcc2-4d51-a172-5202131b57f9),segment_id=6da795d9-bcc2-4d51-a172-5202131b57f9)] {{(pid=110214) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:16:05.964704 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:05.979148 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25f13a27-4463-4f82-982e-337fe7a23d39 None None] DHCP port deletion for 9d7d2d3e-f720-4915-9cdc-d3fa1cb712df request from dv-cinder-773870-6-iscsi {{(pid=110216) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Jun 17 11:16:06.025940 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-25f13a27-4463-4f82-982e-337fe7a23d39 None None] Deleting port d642d88d-f459-4c3f-82a1-35a0cdc09cee {{(pid=110216) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1907}} Jun 17 11:16:06.026327 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-25f13a27-4463-4f82-982e-337fe7a23d39 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8743358259869'] for port, before_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:06.036823 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.plugin [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Calling delete_port for d642d88d-f459-4c3f-82a1-35a0cdc09cee owned by network:dhcp {{(pid=110214) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:16:06.090685 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.db [None req-25f13a27-4463-4f82-982e-337fe7a23d39 None None] For port d642d88d-f459-4c3f-82a1-35a0cdc09cee, host dv-cinder-773870-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773870-6-iscsi',level=0,port_id=d642d88d-f459-4c3f-82a1-35a0cdc09cee,segment=NetworkSegment(6da795d9-bcc2-4d51-a172-5202131b57f9),segment_id=6da795d9-bcc2-4d51-a172-5202131b57f9)] {{(pid=110216) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} Jun 17 11:16:06.091108 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-25f13a27-4463-4f82-982e-337fe7a23d39 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-8288729'] for port, precommit_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:06.156334 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-25f13a27-4463-4f82-982e-337fe7a23d39 None None] Calling delete_port for d642d88d-f459-4c3f-82a1-35a0cdc09cee owned by network:dhcp {{(pid=110216) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1980}} Jun 17 11:16:06.173168 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6239423'] for port, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:06.176647 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-9a2a2d84-bd26-4ab5-8bca-370b7a978ec5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:06.198566 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] No DVR routers for this DVR port d642d88d-f459-4c3f-82a1-35a0cdc09cee on host dv-cinder-773870-6-iscsi {{(pid=110214) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:16:06.202474 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Pushing event deleted for resources: {'Port': ['ID=d642d88d-f459-4c3f-82a1-35a0cdc09cee,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:06.205194 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:06.233782 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-25f13a27-4463-4f82-982e-337fe7a23d39 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-928413', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-25320', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7899485', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8743358265465', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8743357808159'] for port, after_delete {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:06.237001 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:06.259845 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f13a27-4463-4f82-982e-337fe7a23d39 None None] Pushing event deleted for resources: {'Port': ['ID=d642d88d-f459-4c3f-82a1-35a0cdc09cee,revision_number=None']} {{(pid=110216) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:06.262966 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG oslo_concurrency.lockutils [None req-25f13a27-4463-4f82-982e-337fe7a23d39 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=110216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:06.263773 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25f13a27-4463-4f82-982e-337fe7a23d39 None None] No DVR routers for this DVR port d642d88d-f459-4c3f-82a1-35a0cdc09cee on host dv-cinder-773870-6-iscsi {{(pid=110216) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Jun 17 11:16:06.267948 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-971151', 'neutron.services.segments.db._delete_segments_for_network-8743358330161'] for network, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:06.278054 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9d7d2d3e-f720-4915-9cdc-d3fa1cb712df']}} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:06.291247 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6da795d9-bcc2-4d51-a172-5202131b57f9') {'for_net_delete': True} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:06.291539 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.services.segments.db [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6da795d9-bcc2-4d51-a172-5202131b57f9') {} {{(pid=110214) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Jun 17 11:16:06.300366 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8743358331010', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6228436'] for segment, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:06.312989 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979'] for segment, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Releasing vlan 112 on physical network physnet1 to pool {{(pid=110214) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-966979', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6239464'] for segment, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: Traceback (most recent call last): Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: timer() Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: cb(*args, **kw) Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: return func(*args, **kwargs) Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: self._notify() Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: self.callback(batched_events) Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: event.method(event) Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_id = self._get_aggregate_id(event.segment_id) Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: aggregate_uuid = self.p_client.list_aggregates( Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: return f(self, *a, **k) Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._get(url).json() Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: return self._client.get(url, endpoint_filter=self._ks_filter, Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: return self.request(url, 'GET', **kwargs) Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: base_url = self.get_endpoint(auth, allow=allow, Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: auth = self._auth_required(auth, 'determine endpoint URL') Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Jun 17 11:16:06.323052 dv-cinder-773870-6-iscsi neutron-server[110214]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Jun 17 11:16:06.453622 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:16:06.461195 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-971156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-8298963', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7899476', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-8286535'] for network, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:06.465832 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-808f29f8-8836-4808-a4ac-c6156d752e83 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:06.468536 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7899467'] for network, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:06.470246 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] 10.222.0.41 "DELETE /v2.0/networks/9d7d2d3e-f720-4915-9cdc-d3fa1cb712df HTTP/1.1" status: 204 len: 168 time: 0.6975768 Jun 17 11:16:06.473716 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:16:06.474485 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device 3ccaf261-8495-4cce-b1fe-0a21cafe2da6 not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:16:06.474485 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d642d88d-f459-4c3f-82a1-35a0cdc09cee no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:16:06.480978 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Pushing event deleted for resources: {'Network': ['ID=9d7d2d3e-f720-4915-9cdc-d3fa1cb712df,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:06.487697 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-57220fa2-7647-494f-a79e-93a21fa57a22 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:06.500291 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: d642d88d-f459-4c3f-82a1-35a0cdc09cee {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:16:06.500291 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device d642d88d-f459-4c3f-82a1-35a0cdc09cee not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:16:06.500291 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device e10e5a3c-f4c9-447f-a41d-92fddeec496d no longer exists at agent ovs-agent-dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Jun 17 11:16:06.518634 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.plugin [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] No Port match for: e10e5a3c-f4c9-447f-a41d-92fddeec496d {{(pid=110216) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2234}} Jun 17 11:16:06.519018 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron.plugins.ml2.rpc [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Device e10e5a3c-f4c9-447f-a41d-92fddeec496d not bound to the agent host dv-cinder-773870-6-iscsi {{(pid=110216) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Jun 17 11:16:06.808922 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43846) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:06.847904 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-34ffff11-de54-4565-8e6d-c40b780bce20 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=a7706f138ac3465ba5820edf148d8153&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0376124 Jun 17 11:16:06.850359 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43848) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:06.903600 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-103853ac-3708-4603-b5fe-1a805b8f38b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:06.926017 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-103853ac-3708-4603-b5fe-1a805b8f38b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:07.042042 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-103853ac-3708-4603-b5fe-1a805b8f38b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:07.044545 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-103853ac-3708-4603-b5fe-1a805b8f38b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:07.046523 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-103853ac-3708-4603-b5fe-1a805b8f38b9 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/eb6567cf-c7e7-4314-ba31-ceb76c207233 HTTP/1.1" status: 204 len: 168 time: 0.1942284 Jun 17 11:16:07.046523 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-8b1c4d00-3de4-49c4-b741-cba4c67dcc67 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:07.054336 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-103853ac-3708-4603-b5fe-1a805b8f38b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb6567cf-c7e7-4314-ba31-ceb76c207233,revision_number=None']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:07.056659 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-103853ac-3708-4603-b5fe-1a805b8f38b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:07.718446 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43856) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:07.762111 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-01b505c6-8423-4665-916e-302fe0166c51 admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=1d11d9badea6421585a99e4199bc739c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0420787 Jun 17 11:16:07.764491 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43858) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:07.811697 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-20f084fb-d9f9-45dd-b5d9-0d8ff7aa0b84 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:07.832978 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-20f084fb-d9f9-45dd-b5d9-0d8ff7aa0b84 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:07.980976 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-20f084fb-d9f9-45dd-b5d9-0d8ff7aa0b84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:07.983533 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-20f084fb-d9f9-45dd-b5d9-0d8ff7aa0b84 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:07.984664 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-20f084fb-d9f9-45dd-b5d9-0d8ff7aa0b84 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/ce301ec3-88ff-4f39-b3e5-e16a5ee1e3db HTTP/1.1" status: 204 len: 168 time: 0.2192571 Jun 17 11:16:07.985467 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-d7ea296a-f96d-4c74-a938-544532870d5a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:07.993546 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20f084fb-d9f9-45dd-b5d9-0d8ff7aa0b84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce301ec3-88ff-4f39-b3e5-e16a5ee1e3db,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:07.995877 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-20f084fb-d9f9-45dd-b5d9-0d8ff7aa0b84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:08.169849 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:20.683699 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-92ebdeee-412d-4d69-8c03-7242103533b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:23.346073 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-83140295-36a2-4fc7-9cfc-96c4c278f1e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:23.632532 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:24.504519 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:26.034534 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:16:26.847130 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:30.204977 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.wsgi [-] (110215) accepted ('10.222.0.41', 43936) {{(pid=110215) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:30.306055 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-55df5ac7-8768-4460-98b0-7e5cb4b2c84f admin admin] Notify callbacks [] for security_group, before_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:30.397581 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-55df5ac7-8768-4460-98b0-7e5cb4b2c84f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:30.452585 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron_lib.callbacks.manager [None req-55df5ac7-8768-4460-98b0-7e5cb4b2c84f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_create {{(pid=110215) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:30.456405 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-c3b33a6e-63d2-46aa-a056-5ecd7231e63d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:30.490130 dv-cinder-773870-6-iscsi neutron-server[110215]: INFO neutron.wsgi [None req-55df5ac7-8768-4460-98b0-7e5cb4b2c84f admin admin] 10.222.0.41 "GET /v2.0/security-groups?tenant_id=0eb9eda2504e43dd9b854345d9c84f9f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2841363 Jun 17 11:16:30.491036 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55df5ac7-8768-4460-98b0-7e5cb4b2c84f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f216816-441b-40e5-8c49-e6e3c2d6a0bf,revision_number=1']} {{(pid=110215) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:30.493597 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.wsgi [-] (110214) accepted ('10.222.0.41', 43940) {{(pid=110214) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Jun 17 11:16:30.494083 dv-cinder-773870-6-iscsi neutron-server[110215]: DEBUG oslo_concurrency.lockutils [None req-55df5ac7-8768-4460-98b0-7e5cb4b2c84f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=110215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:30.542659 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-03ac136d-08e1-4e00-ad1b-96364b1361e6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:30.562496 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-03ac136d-08e1-4e00-ad1b-96364b1361e6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:30.683118 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-03ac136d-08e1-4e00-ad1b-96364b1361e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-8298932'] for security_group, after_delete {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:30.685761 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron_lib.callbacks.manager [None req-03ac136d-08e1-4e00-ad1b-96364b1361e6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=110214) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:30.686933 dv-cinder-773870-6-iscsi neutron-server[110214]: INFO neutron.wsgi [None req-03ac136d-08e1-4e00-ad1b-96364b1361e6 admin admin] 10.222.0.41 "DELETE /v2.0/security-groups/7f216816-441b-40e5-8c49-e6e3c2d6a0bf HTTP/1.1" status: 204 len: 168 time: 0.1914940 Jun 17 11:16:30.687688 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-f53c7f3f-00d9-4ef8-a857-de7928c254a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jun 17 11:16:30.706565 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ac136d-08e1-4e00-ad1b-96364b1361e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f216816-441b-40e5-8c49-e6e3c2d6a0bf,revision_number=None']} {{(pid=110214) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Jun 17 11:16:30.706565 dv-cinder-773870-6-iscsi neutron-server[110214]: DEBUG oslo_concurrency.lockutils [None req-03ac136d-08e1-4e00-ad1b-96364b1361e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.010s {{(pid=110214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jun 17 11:16:38.146209 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:50.665752 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-e8bdc928-880f-47a9-a1eb-81dec8705fdf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:53.351337 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-121a31cd-a53e-4eba-93bc-f696a53f941d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:53.613964 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:54.510792 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:16:56.835134 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:03.033698 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:17:08.190690 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:20.653129 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-47f53782-bcbd-4ece-ac50-cf4684f0fbad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:23.350066 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-764ae88a-7416-4cf8-afa7-8a428c1ba452 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:23.578420 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:24.516177 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:26.852011 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:38.155702 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:40.032196 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:17:50.681115 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-fc444816-10b5-464f-972f-325b5a53f052 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:53.348187 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-3128f17a-141d-45a9-a034-2a5930725700 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:53.589331 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:54.514166 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:17:56.874885 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:08.154559 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:17.030557 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:18:20.657122 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-ece12c8d-c6e7-4e27-86c8-3b845e6c2749 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:23.375592 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8454d26a-9d1a-42be-9da3-e899f6f0818f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:23.588404 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:24.542789 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:26.851086 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:38.176404 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:50.655851 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-fdcdcfde-2abc-4c80-94d9-8730d55d0c33 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:53.330220 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1c2f07d5-7bfb-4db2-a6f5-5cfba0b0717a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:53.569268 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:54.028440 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:18:54.507625 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:18:56.856008 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:08.186565 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:20.655060 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-7ba77141-acc9-4b0a-9ecc-77cc001ad3f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:23.443534 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-28f03da7-fa70-4add-a09d-29a97fd2155e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:23.580454 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:24.552289 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:26.858049 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:31.027597 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:19:38.197111 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:50.654157 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a90ff6e3-37af-4bb9-8883-e9c04492ad2f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:53.351109 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9871300a-3688-4596-9403-7f75a2de4289 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:53.602346 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:54.585641 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:19:56.854176 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:08.026894 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:20:08.202205 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:20.658929 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-c7701bf1-a89e-4dc7-9725-8cee4ef253cd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:23.338966 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-0e8ee8b5-1b3d-4d6f-9067-857842ed1fd3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:23.647572 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:24.532947 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:26.888147 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:38.241412 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:45.028343 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:20:50.675289 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-75b0c49a-ea0f-4e37-a85c-90524f780ce6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:53.348994 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-8f69e07e-c5a2-4f2e-bd79-ee0bfd4e5f3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:53.583477 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:54.578047 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:20:56.869127 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:08.217792 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:20.696856 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9b3f2c9e-cf92-4652-b36c-ac586b883500 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:22.027237 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} Jun 17 11:21:23.354092 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a4396202-bade-409e-8800-23ece8bfe3ba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:23.611962 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:24.577143 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:26.898068 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:38.239372 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-69d31b7e-1eb9-4d25-92a2-33517f7483d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:50.759077 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-a78db903-bbd4-4b1f-a364-f43fa1cb264e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:53.370589 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-f6642a49-a15a-456a-8250-0b026207ea7e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:53.661879 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-2ec30d94-4630-461d-90b9-5f76528c2974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:54.598404 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-9647fbeb-9715-4a34-8f79-2c3ace03aeff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:56.970305 dv-cinder-773870-6-iscsi neutron-server[110216]: DEBUG neutron_lib.callbacks.manager [None req-1206e750-bdd0-4af0-a33c-a9b0cdcb157c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8743358330143', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-973137'] for agent, after_update {{(pid=110216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Jun 17 11:21:59.026225 dv-cinder-773870-6-iscsi neutron-server[110218]: DEBUG neutron.db.agents_db [None req-93c6e6e2-9548-4cfe-a25e-293ecaa3ed7d None None] Agent healthcheck: found 6 active agents {{(pid=110218) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}